2023-02-13 12:00:57,578 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-13 12:00:57,779 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365 2023-02-13 12:00:57,792 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-13 12:00:57,793 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/cluster_b4fd01dc-bc14-be1f-77f3-175feca8744e, deleteOnExit=true 2023-02-13 12:00:57,793 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 12:00:57,794 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/test.cache.data in system properties and HBase conf 2023-02-13 12:00:57,795 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 12:00:57,796 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/hadoop.log.dir in system properties and HBase conf 2023-02-13 12:00:57,796 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 12:00:57,797 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 12:00:57,797 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 12:00:57,893 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 12:00:58,189 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 12:00:58,192 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 12:00:58,193 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 12:00:58,193 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 12:00:58,193 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 12:00:58,194 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 12:00:58,194 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 12:00:58,194 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 12:00:58,194 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 12:00:58,195 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 12:00:58,195 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/nfs.dump.dir in system properties and HBase conf 2023-02-13 12:00:58,196 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/java.io.tmpdir in system properties and HBase conf 2023-02-13 12:00:58,196 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 12:00:58,196 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 12:00:58,197 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 12:00:58,631 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 12:00:58,635 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 12:00:59,078 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 12:00:59,220 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 12:00:59,233 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 12:00:59,265 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 12:00:59,292 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/java.io.tmpdir/Jetty_localhost_localdomain_34839_hdfs____.usha4p/webapp 2023-02-13 12:00:59,402 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:34839 2023-02-13 12:00:59,431 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 12:00:59,432 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 12:00:59,928 WARN [Listener at localhost.localdomain/33957] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 12:01:00,016 WARN [Listener at localhost.localdomain/33957] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 12:01:00,032 WARN [Listener at localhost.localdomain/33957] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 12:01:00,037 INFO [Listener at localhost.localdomain/33957] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 12:01:00,042 INFO [Listener at localhost.localdomain/33957] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/java.io.tmpdir/Jetty_localhost_36607_datanode____.fb0g4f/webapp 2023-02-13 12:01:00,145 INFO [Listener at localhost.localdomain/33957] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36607 2023-02-13 12:01:00,694 WARN [Listener at localhost.localdomain/40603] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 12:01:01,634 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xee71eea44d448f46: Processing first storage report for DS-5b27b7e3-0feb-471b-bcc6-a18f0f01ea43 from datanode 3de10439-cfaa-4823-8c1e-d41da33e5075 2023-02-13 12:01:01,635 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xee71eea44d448f46: from storage DS-5b27b7e3-0feb-471b-bcc6-a18f0f01ea43 node DatanodeRegistration(127.0.0.1:40581, datanodeUuid=3de10439-cfaa-4823-8c1e-d41da33e5075, infoPort=33091, infoSecurePort=0, ipcPort=40603, storageInfo=lv=-57;cid=testClusterID;nsid=535584131;c=1676289658691), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-13 12:01:01,636 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xee71eea44d448f46: Processing first storage report for DS-a31f03cb-32e3-4f56-aa9c-3589582e72d0 from datanode 3de10439-cfaa-4823-8c1e-d41da33e5075 2023-02-13 12:01:01,636 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xee71eea44d448f46: from storage DS-a31f03cb-32e3-4f56-aa9c-3589582e72d0 node DatanodeRegistration(127.0.0.1:40581, datanodeUuid=3de10439-cfaa-4823-8c1e-d41da33e5075, infoPort=33091, infoSecurePort=0, ipcPort=40603, storageInfo=lv=-57;cid=testClusterID;nsid=535584131;c=1676289658691), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 12:01:01,715 DEBUG [Listener at localhost.localdomain/40603] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365 2023-02-13 12:01:01,764 INFO [Listener at localhost.localdomain/40603] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/cluster_b4fd01dc-bc14-be1f-77f3-175feca8744e/zookeeper_0, clientPort=62284, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/cluster_b4fd01dc-bc14-be1f-77f3-175feca8744e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/cluster_b4fd01dc-bc14-be1f-77f3-175feca8744e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 12:01:01,776 INFO [Listener at localhost.localdomain/40603] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62284 2023-02-13 12:01:01,783 INFO [Listener at localhost.localdomain/40603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 12:01:01,785 INFO [Listener at localhost.localdomain/40603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 12:01:02,404 INFO [Listener at localhost.localdomain/40603] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f with version=8 2023-02-13 12:01:02,405 INFO [Listener at localhost.localdomain/40603] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/hbase-staging 2023-02-13 12:01:02,776 INFO [Listener at localhost.localdomain/40603] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 12:01:03,173 INFO [Listener at localhost.localdomain/40603] client.ConnectionUtils(127): master/jenkins-hbase16:0 server-side Connection retries=3 2023-02-13 12:01:03,198 INFO [Listener at localhost.localdomain/40603] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 12:01:03,198 INFO [Listener at localhost.localdomain/40603] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 12:01:03,198 INFO [Listener at localhost.localdomain/40603] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 12:01:03,198 INFO [Listener at localhost.localdomain/40603] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 12:01:03,198 INFO [Listener at localhost.localdomain/40603] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 12:01:03,309 INFO [Listener at localhost.localdomain/40603] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 12:01:03,370 DEBUG [Listener at localhost.localdomain/40603] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 12:01:03,446 INFO [Listener at localhost.localdomain/40603] ipc.NettyRpcServer(120): Bind to /188.40.62.62:44533 2023-02-13 12:01:03,456 INFO [Listener at localhost.localdomain/40603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 12:01:03,458 INFO [Listener at localhost.localdomain/40603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 12:01:03,475 INFO [Listener at localhost.localdomain/40603] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44533 connecting to ZooKeeper ensemble=127.0.0.1:62284 2023-02-13 12:01:03,543 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:445330x0, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 12:01:03,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44533-0x10052c3c9ad0000 connected 2023-02-13 12:01:03,619 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 12:01:03,620 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 12:01:03,626 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 12:01:03,634 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44533 2023-02-13 12:01:03,635 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44533 2023-02-13 12:01:03,635 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44533 2023-02-13 12:01:03,636 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44533 2023-02-13 12:01:03,636 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44533 2023-02-13 12:01:03,641 INFO [Listener at localhost.localdomain/40603] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f, hbase.cluster.distributed=false 2023-02-13 12:01:03,698 INFO [Listener at localhost.localdomain/40603] client.ConnectionUtils(127): regionserver/jenkins-hbase16:0 server-side Connection retries=3 2023-02-13 12:01:03,698 INFO [Listener at localhost.localdomain/40603] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 12:01:03,698 INFO [Listener at localhost.localdomain/40603] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 12:01:03,698 INFO [Listener at localhost.localdomain/40603] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 12:01:03,699 INFO [Listener at localhost.localdomain/40603] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 12:01:03,699 INFO [Listener at localhost.localdomain/40603] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 12:01:03,703 INFO [Listener at localhost.localdomain/40603] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 12:01:03,706 INFO [Listener at localhost.localdomain/40603] ipc.NettyRpcServer(120): Bind to /188.40.62.62:39857 2023-02-13 12:01:03,708 INFO [Listener at localhost.localdomain/40603] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 12:01:03,713 DEBUG [Listener at localhost.localdomain/40603] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 12:01:03,714 INFO [Listener at localhost.localdomain/40603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 12:01:03,716 INFO [Listener at localhost.localdomain/40603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 12:01:03,718 INFO [Listener at localhost.localdomain/40603] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39857 connecting to ZooKeeper ensemble=127.0.0.1:62284 2023-02-13 12:01:03,730 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:398570x0, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 12:01:03,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39857-0x10052c3c9ad0001 connected 2023-02-13 12:01:03,731 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 12:01:03,733 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 12:01:03,733 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 12:01:03,734 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39857 2023-02-13 12:01:03,734 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39857 2023-02-13 12:01:03,735 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39857 2023-02-13 12:01:03,735 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39857 2023-02-13 12:01:03,736 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39857 2023-02-13 12:01:03,738 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:01:03,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 12:01:03,757 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:01:03,783 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 12:01:03,783 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 12:01:03,783 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:01:03,784 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 12:01:03,785 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase16.apache.org,44533,1676289662559 from backup master directory 2023-02-13 12:01:03,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 12:01:03,797 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:01:03,797 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 12:01:03,798 WARN [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 12:01:03,798 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:01:03,802 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 12:01:03,804 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 12:01:03,884 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/hbase.id with ID: ab1b9156-28f4-403a-9d07-583ba7665cc2 2023-02-13 12:01:03,928 INFO [master/jenkins-hbase16:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 12:01:03,949 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:01:03,989 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x32b568fb to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:01:04,023 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2da674c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:01:04,041 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 12:01:04,042 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 12:01:04,056 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 12:01:04,056 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 12:01:04,057 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 12:01:04,060 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 12:01:04,061 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 12:01:04,087 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/data/master/store-tmp 2023-02-13 12:01:04,517 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:04,519 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 12:01:04,519 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 12:01:04,519 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 12:01:04,519 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 12:01:04,520 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 12:01:04,520 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 12:01:04,520 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676289664518Disabling compacts and flushes for region at 1676289664519 (+1 ms)Disabling writes for close at 1676289664520 (+1 ms)Writing region close event to WAL at 1676289664520Closed at 1676289664520 2023-02-13 12:01:04,523 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/WALs/jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:01:04,544 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C44533%2C1676289662559, suffix=, logDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/WALs/jenkins-hbase16.apache.org,44533,1676289662559, archiveDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/oldWALs, maxLogs=10 2023-02-13 12:01:04,589 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40581,DS-5b27b7e3-0feb-471b-bcc6-a18f0f01ea43,DISK] 2023-02-13 12:01:04,596 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 12:01:04,645 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/WALs/jenkins-hbase16.apache.org,44533,1676289662559/jenkins-hbase16.apache.org%2C44533%2C1676289662559.1676289664553 2023-02-13 12:01:04,645 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40581,DS-5b27b7e3-0feb-471b-bcc6-a18f0f01ea43,DISK]] 2023-02-13 12:01:04,646 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:01:04,646 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:04,649 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 12:01:04,649 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 12:01:04,702 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 12:01:04,709 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 12:01:04,729 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 12:01:04,739 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:04,744 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 12:01:04,746 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 12:01:04,760 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 12:01:04,764 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:01:04,766 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60033509, jitterRate=-0.10543100535869598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:01:04,766 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676289664674Initializing all the Stores at 1676289664676 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676289664676Cleaning up temporary data from old regions at 1676289664751 (+75 ms)Cleaning up detritus from prior splits at 1676289664752 (+1 ms)Region opened successfully at 1676289664766 (+14 ms) 2023-02-13 12:01:04,767 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 12:01:04,784 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 12:01:04,784 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 12:01:04,786 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 12:01:04,787 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 12:01:04,813 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 25 msec 2023-02-13 12:01:04,813 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 12:01:04,834 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 12:01:04,839 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 12:01:04,860 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 12:01:04,862 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 12:01:04,865 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 12:01:04,869 INFO [master/jenkins-hbase16:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 12:01:04,873 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 12:01:04,891 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:01:04,893 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 12:01:04,894 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 12:01:04,907 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 12:01:04,922 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 12:01:04,922 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 12:01:04,922 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:01:04,922 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase16.apache.org,44533,1676289662559, sessionid=0x10052c3c9ad0000, setting cluster-up flag (Was=false) 2023-02-13 12:01:04,949 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:01:04,974 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 12:01:04,976 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:01:04,997 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:01:05,024 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 12:01:05,026 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:01:05,029 WARN [master/jenkins-hbase16:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/.tmp 2023-02-13 12:01:05,041 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(952): ClusterId : ab1b9156-28f4-403a-9d07-583ba7665cc2 2023-02-13 12:01:05,045 DEBUG [RS:0;jenkins-hbase16:39857] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 12:01:05,057 DEBUG [RS:0;jenkins-hbase16:39857] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 12:01:05,058 DEBUG [RS:0;jenkins-hbase16:39857] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 12:01:05,067 DEBUG [RS:0;jenkins-hbase16:39857] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 12:01:05,068 DEBUG [RS:0;jenkins-hbase16:39857] zookeeper.ReadOnlyZKClient(139): Connect 0x49afd4b0 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:01:05,081 DEBUG [RS:0;jenkins-hbase16:39857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@476823f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:01:05,081 DEBUG [RS:0;jenkins-hbase16:39857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4357bfc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-02-13 12:01:05,098 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase16:39857 2023-02-13 12:01:05,101 INFO [RS:0;jenkins-hbase16:39857] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 12:01:05,101 INFO [RS:0;jenkins-hbase16:39857] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 12:01:05,101 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 12:01:05,104 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase16.apache.org,44533,1676289662559 with isa=jenkins-hbase16.apache.org/188.40.62.62:39857, startcode=1676289663697 2023-02-13 12:01:05,117 DEBUG [RS:0;jenkins-hbase16:39857] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 12:01:05,134 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 12:01:05,151 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-02-13 12:01:05,151 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-02-13 12:01:05,151 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-02-13 12:01:05,151 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-02-13 12:01:05,151 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase16:0, corePoolSize=10, maxPoolSize=10 2023-02-13 12:01:05,151 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,152 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-02-13 12:01:05,152 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,157 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676289695156 2023-02-13 12:01:05,159 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 12:01:05,161 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 12:01:05,161 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 12:01:05,166 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 12:01:05,169 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:35413, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 12:01:05,171 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 12:01:05,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 12:01:05,180 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 12:01:05,181 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 12:01:05,181 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 12:01:05,181 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 12:01:05,182 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,184 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 12:01:05,186 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 12:01:05,186 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 12:01:05,194 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 12:01:05,194 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 12:01:05,195 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1676289665195,5,FailOnTimeoutGroup] 2023-02-13 12:01:05,196 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1676289665196,5,FailOnTimeoutGroup] 2023-02-13 12:01:05,196 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,196 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 12:01:05,198 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,198 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,199 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 12:01:05,200 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 12:01:05,200 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f 2023-02-13 12:01:05,211 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:05,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 12:01:05,214 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(2829): Master is not running yet 2023-02-13 12:01:05,214 WARN [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 100 ms and then retrying. 2023-02-13 12:01:05,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/info 2023-02-13 12:01:05,217 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 12:01:05,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:05,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 12:01:05,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/rep_barrier 2023-02-13 12:01:05,221 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 12:01:05,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:05,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 12:01:05,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/table 2023-02-13 12:01:05,225 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 12:01:05,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:05,227 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740 2023-02-13 12:01:05,228 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740 2023-02-13 12:01:05,232 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 12:01:05,234 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 12:01:05,237 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:01:05,238 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71622521, jitterRate=0.06725873053073883}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 12:01:05,238 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676289665211Initializing all the Stores at 1676289665212 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676289665212Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676289665212Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676289665213 (+1 ms)Cleaning up temporary data from old regions at 1676289665230 (+17 ms)Cleaning up detritus from prior splits at 1676289665231 (+1 ms)Region opened successfully at 1676289665238 (+7 ms) 2023-02-13 12:01:05,238 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 12:01:05,238 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 12:01:05,238 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 12:01:05,238 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 12:01:05,238 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 12:01:05,239 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 12:01:05,239 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676289665238Disabling compacts and flushes for region at 1676289665238Disabling writes for close at 1676289665238Writing region close event to WAL at 1676289665239 (+1 ms)Closed at 1676289665239 2023-02-13 12:01:05,243 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 12:01:05,243 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 12:01:05,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 12:01:05,261 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 12:01:05,263 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 12:01:05,316 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase16.apache.org,44533,1676289662559 with isa=jenkins-hbase16.apache.org/188.40.62.62:39857, startcode=1676289663697 2023-02-13 12:01:05,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.ServerManager(394): Registering regionserver=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:05,334 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f 2023-02-13 12:01:05,334 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:33957 2023-02-13 12:01:05,335 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 12:01:05,347 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 12:01:05,348 DEBUG [RS:0;jenkins-hbase16:39857] zookeeper.ZKUtil(162): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:05,348 WARN [RS:0;jenkins-hbase16:39857] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 12:01:05,349 INFO [RS:0;jenkins-hbase16:39857] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 12:01:05,349 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/WALs/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:05,350 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,39857,1676289663697] 2023-02-13 12:01:05,361 DEBUG [RS:0;jenkins-hbase16:39857] zookeeper.ZKUtil(162): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:05,371 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 12:01:05,377 INFO [RS:0;jenkins-hbase16:39857] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 12:01:05,393 INFO [RS:0;jenkins-hbase16:39857] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 12:01:05,396 INFO [RS:0;jenkins-hbase16:39857] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:01:05,396 INFO [RS:0;jenkins-hbase16:39857] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,397 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 12:01:05,403 INFO [RS:0;jenkins-hbase16:39857] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,403 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,403 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,403 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,403 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,404 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,404 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-02-13 12:01:05,404 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,404 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,404 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,404 DEBUG [RS:0;jenkins-hbase16:39857] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-02-13 12:01:05,405 INFO [RS:0;jenkins-hbase16:39857] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,405 INFO [RS:0;jenkins-hbase16:39857] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,405 INFO [RS:0;jenkins-hbase16:39857] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,415 DEBUG [jenkins-hbase16:44533] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-13 12:01:05,418 INFO [RS:0;jenkins-hbase16:39857] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 12:01:05,418 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,39857,1676289663697, state=OPENING 2023-02-13 12:01:05,419 INFO [RS:0;jenkins-hbase16:39857] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,39857,1676289663697-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,432 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 12:01:05,434 INFO [RS:0;jenkins-hbase16:39857] regionserver.Replication(203): jenkins-hbase16.apache.org,39857,1676289663697 started 2023-02-13 12:01:05,434 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1638): Serving as jenkins-hbase16.apache.org,39857,1676289663697, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:39857, sessionid=0x10052c3c9ad0001 2023-02-13 12:01:05,434 DEBUG [RS:0;jenkins-hbase16:39857] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 12:01:05,434 DEBUG [RS:0;jenkins-hbase16:39857] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:05,434 DEBUG [RS:0;jenkins-hbase16:39857] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,39857,1676289663697' 2023-02-13 12:01:05,435 DEBUG [RS:0;jenkins-hbase16:39857] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:05,441 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:01:05,441 DEBUG [RS:0;jenkins-hbase16:39857] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:05,441 DEBUG [RS:0;jenkins-hbase16:39857] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 12:01:05,441 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 12:01:05,441 DEBUG [RS:0;jenkins-hbase16:39857] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 12:01:05,442 DEBUG [RS:0;jenkins-hbase16:39857] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:05,442 DEBUG [RS:0;jenkins-hbase16:39857] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,39857,1676289663697' 2023-02-13 12:01:05,442 DEBUG [RS:0;jenkins-hbase16:39857] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 12:01:05,442 DEBUG [RS:0;jenkins-hbase16:39857] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 12:01:05,443 DEBUG [RS:0;jenkins-hbase16:39857] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 12:01:05,443 INFO [RS:0;jenkins-hbase16:39857] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 12:01:05,443 INFO [RS:0;jenkins-hbase16:39857] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 12:01:05,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:05,557 INFO [RS:0;jenkins-hbase16:39857] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C39857%2C1676289663697, suffix=, logDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/WALs/jenkins-hbase16.apache.org,39857,1676289663697, archiveDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/oldWALs, maxLogs=32 2023-02-13 12:01:05,575 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40581,DS-5b27b7e3-0feb-471b-bcc6-a18f0f01ea43,DISK] 2023-02-13 12:01:05,579 INFO [RS:0;jenkins-hbase16:39857] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/WALs/jenkins-hbase16.apache.org,39857,1676289663697/jenkins-hbase16.apache.org%2C39857%2C1676289663697.1676289665560 2023-02-13 12:01:05,579 DEBUG [RS:0;jenkins-hbase16:39857] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40581,DS-5b27b7e3-0feb-471b-bcc6-a18f0f01ea43,DISK]] 2023-02-13 12:01:05,625 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:05,627 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 12:01:05,630 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46850, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 12:01:05,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 12:01:05,641 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 12:01:05,645 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C39857%2C1676289663697.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/WALs/jenkins-hbase16.apache.org,39857,1676289663697, archiveDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/oldWALs, maxLogs=32 2023-02-13 12:01:05,663 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40581,DS-5b27b7e3-0feb-471b-bcc6-a18f0f01ea43,DISK] 2023-02-13 12:01:05,668 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/WALs/jenkins-hbase16.apache.org,39857,1676289663697/jenkins-hbase16.apache.org%2C39857%2C1676289663697.meta.1676289665647.meta 2023-02-13 12:01:05,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40581,DS-5b27b7e3-0feb-471b-bcc6-a18f0f01ea43,DISK]] 2023-02-13 12:01:05,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:01:05,670 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 12:01:05,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 12:01:05,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 12:01:05,694 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 12:01:05,694 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:05,694 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 12:01:05,694 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 12:01:05,697 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 12:01:05,700 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/info 2023-02-13 12:01:05,700 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/info 2023-02-13 12:01:05,700 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 12:01:05,701 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:05,701 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 12:01:05,703 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/rep_barrier 2023-02-13 12:01:05,703 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/rep_barrier 2023-02-13 12:01:05,703 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 12:01:05,704 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:05,704 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 12:01:05,706 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/table 2023-02-13 12:01:05,706 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/table 2023-02-13 12:01:05,706 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 12:01:05,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:05,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740 2023-02-13 12:01:05,711 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740 2023-02-13 12:01:05,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 12:01:05,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 12:01:05,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60632454, jitterRate=-0.0965060293674469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 12:01:05,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676289665695Writing region info on filesystem at 1676289665695Initializing all the Stores at 1676289665697 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676289665697Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676289665697Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676289665697Cleaning up temporary data from old regions at 1676289665713 (+16 ms)Cleaning up detritus from prior splits at 1676289665713Running coprocessor post-open hooks at 1676289665718 (+5 ms)Region opened successfully at 1676289665718 2023-02-13 12:01:05,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676289665619 2023-02-13 12:01:05,742 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 12:01:05,742 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 12:01:05,743 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,39857,1676289663697, state=OPEN 2023-02-13 12:01:05,749 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 12:01:05,749 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 12:01:05,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 12:01:05,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,39857,1676289663697 in 304 msec 2023-02-13 12:01:05,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 12:01:05,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 504 msec 2023-02-13 12:01:05,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 692 msec 2023-02-13 12:01:05,766 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676289663775, completionTime=-1 2023-02-13 12:01:05,766 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-13 12:01:05,767 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 12:01:05,822 DEBUG [hconnection-0x6f8c95dd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:01:05,827 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46864, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:01:05,842 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-13 12:01:05,842 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676289725842 2023-02-13 12:01:05,843 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676289785843 2023-02-13 12:01:05,843 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 75 msec 2023-02-13 12:01:05,876 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,44533,1676289662559-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,877 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,44533,1676289662559-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,877 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,44533,1676289662559-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,878 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase16:44533, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,878 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 12:01:05,885 DEBUG [master/jenkins-hbase16:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 12:01:05,892 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 12:01:05,894 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 12:01:05,901 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 12:01:05,904 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:01:05,906 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:01:05,929 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:01:05,932 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1 empty. 2023-02-13 12:01:05,932 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:01:05,932 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 12:01:06,359 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 12:01:06,364 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d059fb4f5b45884ccdc5e186f572bfc1, NAME => 'hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:01:06,384 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:06,384 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d059fb4f5b45884ccdc5e186f572bfc1, disabling compactions & flushes 2023-02-13 12:01:06,384 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:01:06,384 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:01:06,385 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. after waiting 0 ms 2023-02-13 12:01:06,385 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:01:06,385 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:01:06,385 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d059fb4f5b45884ccdc5e186f572bfc1: Waiting for close lock at 1676289666384Disabling compacts and flushes for region at 1676289666384Disabling writes for close at 1676289666385 (+1 ms)Writing region close event to WAL at 1676289666385Closed at 1676289666385 2023-02-13 12:01:06,392 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:01:06,408 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676289666395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289666395"}]},"ts":"1676289666395"} 2023-02-13 12:01:06,431 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 12:01:06,433 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:01:06,437 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289666433"}]},"ts":"1676289666433"} 2023-02-13 12:01:06,441 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 12:01:06,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d059fb4f5b45884ccdc5e186f572bfc1, ASSIGN}] 2023-02-13 12:01:06,538 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d059fb4f5b45884ccdc5e186f572bfc1, ASSIGN 2023-02-13 12:01:06,540 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d059fb4f5b45884ccdc5e186f572bfc1, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:01:06,692 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d059fb4f5b45884ccdc5e186f572bfc1, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:06,692 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676289666691"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289666691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289666691"}]},"ts":"1676289666691"} 2023-02-13 12:01:06,703 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d059fb4f5b45884ccdc5e186f572bfc1, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:06,867 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:01:06,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d059fb4f5b45884ccdc5e186f572bfc1, NAME => 'hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:01:06,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:01:06,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:06,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:01:06,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:01:06,872 INFO [StoreOpener-d059fb4f5b45884ccdc5e186f572bfc1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:01:06,874 DEBUG [StoreOpener-d059fb4f5b45884ccdc5e186f572bfc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1/info 2023-02-13 12:01:06,874 DEBUG [StoreOpener-d059fb4f5b45884ccdc5e186f572bfc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1/info 2023-02-13 12:01:06,875 INFO [StoreOpener-d059fb4f5b45884ccdc5e186f572bfc1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d059fb4f5b45884ccdc5e186f572bfc1 columnFamilyName info 2023-02-13 12:01:06,876 INFO [StoreOpener-d059fb4f5b45884ccdc5e186f572bfc1-1] regionserver.HStore(310): Store=d059fb4f5b45884ccdc5e186f572bfc1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:06,878 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:01:06,879 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:01:06,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:01:06,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:01:06,890 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened d059fb4f5b45884ccdc5e186f572bfc1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70718132, jitterRate=0.05378228425979614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:01:06,890 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for d059fb4f5b45884ccdc5e186f572bfc1: Running coprocessor pre-open hook at 1676289666869Writing region info on filesystem at 1676289666869Initializing all the Stores at 1676289666871 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676289666871Cleaning up temporary data from old regions at 1676289666880 (+9 ms)Cleaning up detritus from prior splits at 1676289666881 (+1 ms)Running coprocessor post-open hooks at 1676289666890 (+9 ms)Region opened successfully at 1676289666890 2023-02-13 12:01:06,892 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1., pid=6, masterSystemTime=1676289666858 2023-02-13 12:01:06,896 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:01:06,896 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:01:06,898 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d059fb4f5b45884ccdc5e186f572bfc1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:06,898 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676289666897"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289666897"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289666897"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289666897"}]},"ts":"1676289666897"} 2023-02-13 12:01:06,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 12:01:06,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d059fb4f5b45884ccdc5e186f572bfc1, server=jenkins-hbase16.apache.org,39857,1676289663697 in 198 msec 2023-02-13 12:01:06,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 12:01:06,908 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d059fb4f5b45884ccdc5e186f572bfc1, ASSIGN in 371 msec 2023-02-13 12:01:06,909 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:01:06,909 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289666909"}]},"ts":"1676289666909"} 2023-02-13 12:01:06,912 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 12:01:06,923 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:01:06,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.0290 sec 2023-02-13 12:01:07,007 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 12:01:07,016 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 12:01:07,016 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:01:07,064 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 12:01:07,091 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 12:01:07,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 50 msec 2023-02-13 12:01:07,108 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 12:01:07,130 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 12:01:07,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 37 msec 2023-02-13 12:01:07,174 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 12:01:07,191 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 12:01:07,192 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.393sec 2023-02-13 12:01:07,195 INFO [master/jenkins-hbase16:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 12:01:07,198 INFO [master/jenkins-hbase16:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 12:01:07,198 INFO [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 12:01:07,199 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,44533,1676289662559-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 12:01:07,202 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,44533,1676289662559-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 12:01:07,214 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 12:01:07,248 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ReadOnlyZKClient(139): Connect 0x527571c7 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:01:07,259 DEBUG [Listener at localhost.localdomain/40603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41ac3592, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:01:07,280 DEBUG [hconnection-0x3feba2e9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:01:07,293 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:01:07,304 INFO [Listener at localhost.localdomain/40603] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:01:07,305 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ReadOnlyZKClient(139): Connect 0x48d8a74d to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:01:07,317 DEBUG [Listener at localhost.localdomain/40603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@322ddb56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:01:07,317 INFO [Listener at localhost.localdomain/40603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 12:01:07,336 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=209, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=169, AvailableMemoryMB=4839 2023-02-13 12:01:07,347 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:01:07,351 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:38512, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:01:07,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 12:01:07,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:07,365 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:01:07,367 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:01:07,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-13 12:01:07,369 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:07,371 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8 empty. 2023-02-13 12:01:07,372 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:07,373 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-13 12:01:07,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 12:01:07,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 12:01:07,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 12:01:07,792 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 12:01:07,795 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => eae16532ffbd025a3daf5e7ea3cea6e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:01:07,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 12:01:08,211 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:08,212 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing eae16532ffbd025a3daf5e7ea3cea6e8, disabling compactions & flushes 2023-02-13 12:01:08,212 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:08,212 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:08,212 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. after waiting 0 ms 2023-02-13 12:01:08,212 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:08,212 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:08,213 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for eae16532ffbd025a3daf5e7ea3cea6e8: Waiting for close lock at 1676289668212Disabling compacts and flushes for region at 1676289668212Disabling writes for close at 1676289668212Writing region close event to WAL at 1676289668212Closed at 1676289668212 2023-02-13 12:01:08,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:01:08,222 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676289668222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289668222"}]},"ts":"1676289668222"} 2023-02-13 12:01:08,225 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 12:01:08,227 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:01:08,228 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289668228"}]},"ts":"1676289668228"} 2023-02-13 12:01:08,231 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-13 12:01:08,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=eae16532ffbd025a3daf5e7ea3cea6e8, ASSIGN}] 2023-02-13 12:01:08,260 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=eae16532ffbd025a3daf5e7ea3cea6e8, ASSIGN 2023-02-13 12:01:08,262 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=eae16532ffbd025a3daf5e7ea3cea6e8, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:01:08,414 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=eae16532ffbd025a3daf5e7ea3cea6e8, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:08,414 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676289668413"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289668413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289668413"}]},"ts":"1676289668413"} 2023-02-13 12:01:08,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure eae16532ffbd025a3daf5e7ea3cea6e8, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:08,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 12:01:08,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:08,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eae16532ffbd025a3daf5e7ea3cea6e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:01:08,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:08,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:08,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:08,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:08,585 INFO [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:08,589 DEBUG [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:08,589 DEBUG [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:08,594 INFO [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eae16532ffbd025a3daf5e7ea3cea6e8 columnFamilyName family1 2023-02-13 12:01:08,598 INFO [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] regionserver.HStore(310): Store=eae16532ffbd025a3daf5e7ea3cea6e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:08,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:08,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:08,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:08,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:01:08,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened eae16532ffbd025a3daf5e7ea3cea6e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72012631, jitterRate=0.07307182252407074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:01:08,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for eae16532ffbd025a3daf5e7ea3cea6e8: Running coprocessor pre-open hook at 1676289668581Writing region info on filesystem at 1676289668581Initializing all the Stores at 1676289668583 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676289668583Cleaning up temporary data from old regions at 1676289668603 (+20 ms)Cleaning up detritus from prior splits at 1676289668604 (+1 ms)Running coprocessor post-open hooks at 1676289668639 (+35 ms)Region opened successfully at 1676289668639 2023-02-13 12:01:08,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8., pid=11, masterSystemTime=1676289668573 2023-02-13 12:01:08,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:08,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:08,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=eae16532ffbd025a3daf5e7ea3cea6e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:08,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676289668645"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289668645"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289668645"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289668645"}]},"ts":"1676289668645"} 2023-02-13 12:01:08,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 12:01:08,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure eae16532ffbd025a3daf5e7ea3cea6e8, server=jenkins-hbase16.apache.org,39857,1676289663697 in 233 msec 2023-02-13 12:01:08,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-13 12:01:08,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=eae16532ffbd025a3daf5e7ea3cea6e8, ASSIGN in 400 msec 2023-02-13 12:01:08,666 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:01:08,666 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289668666"}]},"ts":"1676289668666"} 2023-02-13 12:01:08,669 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-13 12:01:08,682 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:01:08,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.3210 sec 2023-02-13 12:01:09,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 12:01:09,505 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-13 12:01:09,527 DEBUG [hconnection-0x57f99c28-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:01:09,531 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46880, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:01:09,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:09,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:09,723 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:09,723 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:09,724 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:09,724 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:09,725 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:09,725 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:09,732 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:09,732 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:09,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:09,733 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:09,733 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:09,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:09,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:09,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:09,740 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:09,741 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:09,742 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:09,743 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:09,743 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:09,743 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:09,743 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:09,744 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 12:01:10,287 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309c467f52a9fc4c009d525b632646c284 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511309c467f52a9fc4c009d525b632646c284 2023-02-13 12:01:10,703 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/914c656696e945c99f7dee9c990dd427 2023-02-13 12:01:10,724 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/914c656696e945c99f7dee9c990dd427 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/914c656696e945c99f7dee9c990dd427 2023-02-13 12:01:10,735 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/914c656696e945c99f7dee9c990dd427, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-13 12:01:10,738 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 994ms, sequenceid=5, compaction requested=false 2023-02-13 12:01:10,740 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:10,742 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:10,743 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:10,743 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:10,743 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:10,743 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,743 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:10,743 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:10,780 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,780 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:10,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:10,781 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,781 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:10,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:10,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:10,787 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:10,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b49d6fa[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:10,787 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,799 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,800 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:10,800 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:10,800 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:10,800 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,800 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:10,809 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,809 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:10,809 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:10,810 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:10,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:10,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:10,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:10,817 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:10,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:10,817 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:10,817 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:10,817 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,817 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:10,830 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,830 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:10,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:10,830 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:10,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:10,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:10,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:10,832 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:10,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,834 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,849 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,849 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:10,849 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:10,849 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:10,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:10,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:10,849 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:10,849 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,850 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,850 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,850 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:10,850 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,852 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:10,852 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:10,952 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:10,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:10,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:10,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:10,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,976 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:10,976 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:10,977 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:10,977 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:10,978 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,978 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,988 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,988 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:10,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:10,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:10,988 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:10,988 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:10,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:10,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,989 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,990 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 12:01:10,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:10,990 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:10,990 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:10,990 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:10,990 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:10,991 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:10,991 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:10,991 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:10,991 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 12:01:11,228 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:01:11,376 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 12:01:11,378 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 12:01:11,425 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c01a739da2264b7eabb8dcdfe1af10bb to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c01a739da2264b7eabb8dcdfe1af10bb 2023-02-13 12:01:11,840 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/242c8b01af894c98997f533c07d42106 2023-02-13 12:01:11,852 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/242c8b01af894c98997f533c07d42106 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/242c8b01af894c98997f533c07d42106 2023-02-13 12:01:11,862 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/242c8b01af894c98997f533c07d42106, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 12:01:11,863 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 872ms, sequenceid=9, compaction requested=false 2023-02-13 12:01:11,864 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:11,864 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:11,864 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:11,864 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:11,864 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,864 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:11,864 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:11,905 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,905 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:11,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:11,906 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,906 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:11,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:11,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:11,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:11,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:11,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49667ab4[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:11,913 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:11,913 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,924 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,924 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:11,925 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:11,925 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:11,925 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,925 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:11,954 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,954 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:11,954 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:11,954 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:11,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:11,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:11,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:11,966 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:11,966 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:11,966 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:11,966 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,966 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:11,982 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,983 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,983 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:11,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:11,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:11,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:11,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:11,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:11,985 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:11,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,990 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:11,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,999 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:11,999 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:11,999 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:11,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:11,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:11,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:11,999 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:11,999 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:11,999 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,000 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:12,000 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,000 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:12,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:12,000 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:12,000 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,000 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:12,101 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:12,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:12,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:12,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:12,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,120 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:12,120 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:12,121 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:12,121 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:12,122 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,122 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,132 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:12,132 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:12,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:12,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:12,133 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:12,133 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:12,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:12,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,135 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,135 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 12:01:12,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:12,135 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:12,135 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:12,136 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:12,136 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:12,136 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:12,136 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:12,136 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:12,136 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:12,565 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bd6997a9f3284128ba82f0237c51f952 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201bd6997a9f3284128ba82f0237c51f952 2023-02-13 12:01:12,771 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 12:01:12,772 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 12:01:12,980 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/d5c3c9cf39854b6ba1c4a4c05d08970b 2023-02-13 12:01:12,993 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/d5c3c9cf39854b6ba1c4a4c05d08970b as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/d5c3c9cf39854b6ba1c4a4c05d08970b 2023-02-13 12:01:13,002 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/d5c3c9cf39854b6ba1c4a4c05d08970b, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 12:01:13,003 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 867ms, sequenceid=13, compaction requested=true 2023-02-13 12:01:13,004 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:13,004 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:13,004 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:13,004 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:13,004 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,004 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:13,004 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:13,038 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,038 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:13,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:13,039 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:13,039 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:13,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:13,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:13,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:13,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19b1f06a[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:13,043 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:13,043 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,049 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,049 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:13,049 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:13,050 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:13,050 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,050 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:13,058 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,058 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:13,058 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:13,058 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:13,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:13,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:13,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:13,069 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:13,069 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:13,069 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:13,069 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,069 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:13,080 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,080 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,080 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:13,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:13,080 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,082 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:13,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,090 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,091 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:13,091 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:13,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:13,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:13,091 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:13,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 12:01:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:13,091 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:13,091 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,092 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,092 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,092 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:13,092 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,092 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:13,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:13,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:13,092 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,192 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:13,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:13,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:13,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:13,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,214 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:13,214 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:13,214 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:13,214 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:13,215 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,215 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,224 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,224 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:13,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:13,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:13,225 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:13,225 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:13,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:13,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 12:01:13,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:13,228 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:13,228 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:13,228 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:13,229 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:13,229 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:13,229 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:13,229 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:13,229 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:13,663 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051437e22cac614b1b914386c8d5d6871b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512051437e22cac614b1b914386c8d5d6871b 2023-02-13 12:01:14,078 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/6437163ea2d64182ac9e239edae1958f 2023-02-13 12:01:14,092 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/6437163ea2d64182ac9e239edae1958f as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/6437163ea2d64182ac9e239edae1958f 2023-02-13 12:01:14,101 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/6437163ea2d64182ac9e239edae1958f, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 12:01:14,103 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 874ms, sequenceid=17, compaction requested=true 2023-02-13 12:01:14,103 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:14,103 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:14,103 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:14,103 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:14,104 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,104 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:14,104 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:14,138 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,138 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:14,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:14,139 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,139 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:14,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:14,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:14,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68cd8dce[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:14,142 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:14,142 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,149 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,149 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:14,149 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:14,149 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,149 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:14,149 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:14,158 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:14,158 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:14,158 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:14,158 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:14,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:14,161 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:14,161 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:14,161 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:14,161 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,162 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:14,171 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,171 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:14,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:14,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,171 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:14,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:14,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:14,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:14,172 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,174 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:14,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,188 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:14,188 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,188 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:14,188 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,188 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,189 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,189 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,189 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:14,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:14,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:14,188 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:14,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:14,189 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,189 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:14,189 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:14,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:14,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:14,290 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:14,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:14,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:14,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:14,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,306 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:14,307 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:14,307 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:14,307 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:14,308 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,308 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,315 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,315 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:14,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:14,316 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:14,316 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:14,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 12:01:14,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:14,318 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:14,318 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:14,319 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:14,319 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:14,319 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:14,319 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:14,319 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:14,319 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:14,751 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228bc0e8b0ff2574b1cb680c8111efe79de to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc0e8b0ff2574b1cb680c8111efe79de 2023-02-13 12:01:15,162 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/c732b7092dae40808d240755b6e439fb 2023-02-13 12:01:15,175 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/c732b7092dae40808d240755b6e439fb as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c732b7092dae40808d240755b6e439fb 2023-02-13 12:01:15,182 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c732b7092dae40808d240755b6e439fb, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 12:01:15,183 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 864ms, sequenceid=21, compaction requested=true 2023-02-13 12:01:15,183 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:15,183 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:15,183 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:15,184 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:15,184 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,184 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:15,184 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:15,215 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,215 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:15,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:15,215 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,216 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:15,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:15,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d96682b[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:15,220 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:15,220 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,232 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,233 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:15,233 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:15,233 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:15,234 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,234 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:15,241 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,241 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:15,241 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:15,241 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:15,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:15,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:15,251 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:15,251 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:15,251 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:15,251 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,251 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:15,263 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,263 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,263 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:15,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:15,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:15,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:15,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:15,265 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:15,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:15,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,269 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:15,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,279 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,279 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:15,279 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:15,280 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:15,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:15,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:15,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 12:01:15,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:15,280 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,280 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:15,280 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,280 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,281 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,281 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,281 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:15,281 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:15,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:15,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:15,381 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:15,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:15,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:15,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:15,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,401 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:15,401 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:15,401 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:15,401 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:15,402 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,402 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,407 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:15,407 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:15,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:15,408 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:15,408 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:15,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:15,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,409 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 12:01:15,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:15,409 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:15,409 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:15,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:15,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:15,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:15,410 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:15,410 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:15,410 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:15,843 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231316ce98920a44e5196ff6adc1e280c9a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231316ce98920a44e5196ff6adc1e280c9a 2023-02-13 12:01:16,256 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/c881a71b18b14a839ac20fe9468a268c 2023-02-13 12:01:16,273 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/c881a71b18b14a839ac20fe9468a268c as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c881a71b18b14a839ac20fe9468a268c 2023-02-13 12:01:16,281 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c881a71b18b14a839ac20fe9468a268c, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 12:01:16,282 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 872ms, sequenceid=25, compaction requested=true 2023-02-13 12:01:16,282 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:16,283 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:16,283 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:16,283 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:16,283 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,283 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:16,284 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:16,321 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,321 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:16,322 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,322 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:16,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:16,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@375f08f7[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:16,325 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:16,326 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,332 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,332 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:16,332 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:16,332 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:16,332 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,332 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:16,340 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:16,340 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:16,340 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:16,340 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:16,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:16,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:16,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:16,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:16,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:16,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:16,344 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:16,344 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:16,344 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:16,344 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,344 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:16,355 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,355 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:16,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,355 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:16,355 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,356 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:16,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:16,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:16,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:16,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,365 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:16,366 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,366 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:16,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:16,366 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:16,367 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:16,367 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:16,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:16,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:16,467 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:16,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:16,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:16,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:16,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,485 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:16,485 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:16,485 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:16,485 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:16,486 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,486 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,496 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:16,496 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,497 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,497 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:16,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,500 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,500 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 12:01:16,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,500 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:16,500 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:16,501 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:16,501 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:16,501 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:16,502 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:16,502 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:16,502 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:16,930 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018fae1a9705a440aaaff77cb289bc4cea to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601018fae1a9705a440aaaff77cb289bc4cea 2023-02-13 12:01:16,938 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/eb2aed50f3004c3bb9e3c9f2b29b6a49 2023-02-13 12:01:16,948 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/eb2aed50f3004c3bb9e3c9f2b29b6a49 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/eb2aed50f3004c3bb9e3c9f2b29b6a49 2023-02-13 12:01:16,957 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/eb2aed50f3004c3bb9e3c9f2b29b6a49, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 12:01:16,958 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 456ms, sequenceid=29, compaction requested=true 2023-02-13 12:01:16,959 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:16,959 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:16,959 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:16,959 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:16,959 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,959 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:16,959 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:16,996 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,996 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:16,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:16,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:16,997 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:16,997 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:16,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:16,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:16,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:17,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:17,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21fb9cd6[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:17,002 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:17,002 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,013 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,013 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:17,013 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:17,013 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:17,014 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,014 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:17,024 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:17,024 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:17,024 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:17,024 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:17,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:17,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:17,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:17,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:17,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:17,033 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:17,033 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:17,033 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:17,034 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,034 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:17,040 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,040 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,041 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:17,041 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:17,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:17,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:17,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,044 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:17,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,082 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,082 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:17,083 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:17,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:17,083 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:17,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 12:01:17,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:17,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:17,083 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:17,083 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,085 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:17,085 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:17,085 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,085 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:17,085 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,086 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:17,186 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:17,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:17,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:17,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:17,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,205 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:17,205 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:17,205 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:17,205 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:17,206 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,206 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,215 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:17,215 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:17,216 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:17,216 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,218 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,218 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 12:01:17,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:17,219 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:17,219 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:17,219 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:17,219 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:17,219 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:17,220 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:17,220 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:17,220 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:17,652 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037773386a52564dd9be954c4092c4c3c9 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601037773386a52564dd9be954c4092c4c3c9 2023-02-13 12:01:18,064 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/cfce3883a04b4c3f91963220c58bbdb3 2023-02-13 12:01:18,075 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/cfce3883a04b4c3f91963220c58bbdb3 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/cfce3883a04b4c3f91963220c58bbdb3 2023-02-13 12:01:18,083 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/cfce3883a04b4c3f91963220c58bbdb3, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 12:01:18,084 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 864ms, sequenceid=33, compaction requested=true 2023-02-13 12:01:18,084 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:18,084 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:18,084 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:18,085 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:18,085 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,085 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:18,085 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:18,115 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,115 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:18,116 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,116 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:18,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:18,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:18,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25dcd6da[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:18,120 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:18,120 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,130 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,130 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:18,130 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:18,131 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:18,131 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,131 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:18,140 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:18,140 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,140 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:18,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:18,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:18,140 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:18,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:18,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:18,145 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:18,145 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:18,145 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:18,145 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,145 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:18,154 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,154 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:18,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,155 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:18,155 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:18,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,156 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:18,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,165 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,165 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,165 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:18,165 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:18,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:18,166 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 12:01:18,166 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:18,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:18,166 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:18,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:18,166 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,167 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:18,167 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,167 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:18,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:18,167 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:18,267 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:18,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:18,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:18,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:18,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,288 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:18,288 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:18,289 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:18,289 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:18,289 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,289 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,299 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,299 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:18,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:18,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:18,299 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:18,300 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:18,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:18,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,301 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 12:01:18,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:18,303 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:18,303 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:18,303 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:18,304 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:18,304 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:18,304 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:18,304 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:18,304 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:18,730 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c47fcd2a79b4437ebc657e70755a62ee to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907c47fcd2a79b4437ebc657e70755a62ee 2023-02-13 12:01:19,142 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/4109bd48f4204dbea4de3f2381bd9355 2023-02-13 12:01:19,156 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/4109bd48f4204dbea4de3f2381bd9355 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/4109bd48f4204dbea4de3f2381bd9355 2023-02-13 12:01:19,163 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/4109bd48f4204dbea4de3f2381bd9355, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 12:01:19,165 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 861ms, sequenceid=37, compaction requested=true 2023-02-13 12:01:19,165 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:19,165 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:19,165 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:19,165 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:19,165 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,165 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:19,165 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:19,204 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,205 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:19,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:19,205 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,205 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:19,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:19,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:19,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:19,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:19,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bf5357a[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:19,209 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:19,209 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,215 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,216 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:19,216 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:19,216 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:19,216 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,216 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:19,224 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:19,224 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:19,224 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:19,224 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:19,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:19,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:19,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:19,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:19,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:19,233 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:19,234 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:19,234 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:19,234 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,234 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:19,246 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,246 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,246 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:19,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:19,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:19,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:19,247 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,248 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,257 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,257 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,257 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:19,257 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:19,257 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:19,257 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:19,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:19,257 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:19,258 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,258 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,258 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:19,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:19,258 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:19,259 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:19,359 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:19,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:19,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:19,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:19,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,378 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:19,378 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:19,378 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 12:01:19,378 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 12:01:19,379 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,379 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,388 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:19,388 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:19,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:19,389 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:19,389 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:19,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,390 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,391 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 12:01:19,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:19,391 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 12:01:19,391 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:19,392 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 12:01:19,393 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:19,393 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:19,393 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:19,393 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. started... 2023-02-13 12:01:19,393 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eae16532ffbd025a3daf5e7ea3cea6e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:19,826 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201eeaaeba91624f25830b97b4c9286f18 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511201eeaaeba91624f25830b97b4c9286f18 2023-02-13 12:01:20,237 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/a168aa9dbf3d4bc59f6a69cea9102912 2023-02-13 12:01:20,251 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/a168aa9dbf3d4bc59f6a69cea9102912 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/a168aa9dbf3d4bc59f6a69cea9102912 2023-02-13 12:01:20,259 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/a168aa9dbf3d4bc59f6a69cea9102912, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 12:01:20,260 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eae16532ffbd025a3daf5e7ea3cea6e8 in 867ms, sequenceid=41, compaction requested=true 2023-02-13 12:01:20,260 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:20,260 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:20,260 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:20,260 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:20,260 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,260 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 12:01:20,260 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 12:01:20,349 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,349 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:20,351 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,351 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:20,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:20,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:20,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 12:01:20,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14228643[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:20,356 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 12:01:20,357 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,459 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,460 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 12:01:20,460 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 12:01:20,460 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:20,460 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,460 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:20,474 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 12:01:20,474 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,474 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:20,474 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 12:01:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:20,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:20,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:20,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:20,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 12:01:20,478 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 12:01:20,479 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:20,479 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:20,479 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,479 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:20,488 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,488 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:20,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,488 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:20,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:20,489 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,490 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:20,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:20,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 12:01:20,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:20,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 12:01:20,499 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:20,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:20,499 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:20,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:20,600 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:20,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:20,608 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 12:01:20,612 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36268, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 12:01:20,614 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:20,633 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 12:01:20,633 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 12:01:20,635 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290280635 2023-02-13 12:01:20,635 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:01:20,643 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:01:20,648 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 12:01:20,648 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:20,649 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x61534e27 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:01:20,658 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e448a9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:01:20,660 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:21,568 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010335bad1627fce4c5fb872c18dc48cbfff to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010335bad1627fce4c5fb872c18dc48cbfff 2023-02-13 12:01:21,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:21,587 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:01:21,588 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:38918, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:01:21,601 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:01:21,603 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36274, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:01:21,638 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c088e84c16eb45f3b448b85f697bd557 first=Optional[r3] last=Optional[r6] 2023-02-13 12:01:21,650 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c088e84c16eb45f3b448b85f697bd557}] 2023-02-13 12:01:21,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c088e84c16eb45f3b448b85f697bd557 for inclusion in eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:21,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 12:01:21,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:01:21,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:21,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c088e84c16eb45f3b448b85f697bd557 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1j6qht6p40akvmmoep6vmiohlfar6ak4l809t49cas26cb0liuf3me56i5s0o94t/family1/c088e84c16eb45f3b448b85f697bd557 2023-02-13 12:01:21,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1j6qht6p40akvmmoep6vmiohlfar6ak4l809t49cas26cb0liuf3me56i5s0o94t/family1/c088e84c16eb45f3b448b85f697bd557 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/00b05050243741be931b89f26480839a_SeqId_44_ 2023-02-13 12:01:21,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1j6qht6p40akvmmoep6vmiohlfar6ak4l809t49cas26cb0liuf3me56i5s0o94t/family1/c088e84c16eb45f3b448b85f697bd557 into eae16532ffbd025a3daf5e7ea3cea6e8/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/00b05050243741be931b89f26480839a_SeqId_44_ - updating store file list. 2023-02-13 12:01:21,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/00b05050243741be931b89f26480839a_SeqId_44_ into eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:21,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1j6qht6p40akvmmoep6vmiohlfar6ak4l809t49cas26cb0liuf3me56i5s0o94t/family1/c088e84c16eb45f3b448b85f697bd557 into eae16532ffbd025a3daf5e7ea3cea6e8/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/00b05050243741be931b89f26480839a_SeqId_44_) 2023-02-13 12:01:21,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1j6qht6p40akvmmoep6vmiohlfar6ak4l809t49cas26cb0liuf3me56i5s0o94t/family1/c088e84c16eb45f3b448b85f697bd557 2023-02-13 12:01:21,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 12:01:21,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 12:01:21,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): eae16532ffbd025a3daf5e7ea3cea6e8/family1 is initiating minor compaction 2023-02-13 12:01:21,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@58d55a11; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:21,703 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of eae16532ffbd025a3daf5e7ea3cea6e8/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:21,704 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/242c8b01af894c98997f533c07d42106, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/d5c3c9cf39854b6ba1c4a4c05d08970b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/6437163ea2d64182ac9e239edae1958f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c732b7092dae40808d240755b6e439fb, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c881a71b18b14a839ac20fe9468a268c, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/eb2aed50f3004c3bb9e3c9f2b29b6a49, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/cfce3883a04b4c3f91963220c58bbdb3, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/4109bd48f4204dbea4de3f2381bd9355, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/a168aa9dbf3d4bc59f6a69cea9102912, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/00b05050243741be931b89f26480839a_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp, totalSize=50.2 K 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 242c8b01af894c98997f533c07d42106, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting d5c3c9cf39854b6ba1c4a4c05d08970b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 6437163ea2d64182ac9e239edae1958f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting c732b7092dae40808d240755b6e439fb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting c881a71b18b14a839ac20fe9468a268c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting eb2aed50f3004c3bb9e3c9f2b29b6a49, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting cfce3883a04b4c3f91963220c58bbdb3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 4109bd48f4204dbea4de3f2381bd9355, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting a168aa9dbf3d4bc59f6a69cea9102912, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 12:01:21,705 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 00b05050243741be931b89f26480839a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 12:01:21,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:21,723 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:21,728 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc0e8b0ff2574b1cb680c8111efe79de to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc0e8b0ff2574b1cb680c8111efe79de 2023-02-13 12:01:21,733 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231316ce98920a44e5196ff6adc1e280c9a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231316ce98920a44e5196ff6adc1e280c9a 2023-02-13 12:01:21,735 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601018fae1a9705a440aaaff77cb289bc4cea to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601018fae1a9705a440aaaff77cb289bc4cea 2023-02-13 12:01:21,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601037773386a52564dd9be954c4092c4c3c9 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601037773386a52564dd9be954c4092c4c3c9 2023-02-13 12:01:21,736 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-13 12:01:21,736 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 12:01:21,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:21,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:21,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:21,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:21,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:21,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:21,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:21,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:21,759 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): eae16532ffbd025a3daf5e7ea3cea6e8#family1#compaction#10 average throughput is 0.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:01:22,594 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/df7489fa55c646248748569a00dd72b7 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/df7489fa55c646248748569a00dd72b7 2023-02-13 12:01:22,612 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in eae16532ffbd025a3daf5e7ea3cea6e8/family1 of eae16532ffbd025a3daf5e7ea3cea6e8 into df7489fa55c646248748569a00dd72b7(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:01:22,612 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:22,613 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676289681701; duration=0sec 2023-02-13 12:01:22,614 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:22,629 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056de5d6d156fc4ab6aa1a248e4664eb2a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056de5d6d156fc4ab6aa1a248e4664eb2a 2023-02-13 12:01:22,631 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:22,661 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b1513477f28471ebed597c01710a557 first=Optional[r00] last=Optional[r2] 2023-02-13 12:01:22,662 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b1513477f28471ebed597c01710a557}] 2023-02-13 12:01:22,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b1513477f28471ebed597c01710a557 for inclusion in eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:22,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 12:01:22,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:01:22,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:22,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b1513477f28471ebed597c01710a557 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e0lo5q7bjs7v8othskn2jbj4jo00ubfm84hs77dm2hmkrlds9ggulu4gj3amjdei/family1/8b1513477f28471ebed597c01710a557 2023-02-13 12:01:22,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e0lo5q7bjs7v8othskn2jbj4jo00ubfm84hs77dm2hmkrlds9ggulu4gj3amjdei/family1/8b1513477f28471ebed597c01710a557 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/7a9efc867d2a49449b0053c581d6a76c_SeqId_47_ 2023-02-13 12:01:22,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e0lo5q7bjs7v8othskn2jbj4jo00ubfm84hs77dm2hmkrlds9ggulu4gj3amjdei/family1/8b1513477f28471ebed597c01710a557 into eae16532ffbd025a3daf5e7ea3cea6e8/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/7a9efc867d2a49449b0053c581d6a76c_SeqId_47_ - updating store file list. 2023-02-13 12:01:22,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/7a9efc867d2a49449b0053c581d6a76c_SeqId_47_ into eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:22,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e0lo5q7bjs7v8othskn2jbj4jo00ubfm84hs77dm2hmkrlds9ggulu4gj3amjdei/family1/8b1513477f28471ebed597c01710a557 into eae16532ffbd025a3daf5e7ea3cea6e8/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/7a9efc867d2a49449b0053c581d6a76c_SeqId_47_) 2023-02-13 12:01:22,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e0lo5q7bjs7v8othskn2jbj4jo00ubfm84hs77dm2hmkrlds9ggulu4gj3amjdei/family1/8b1513477f28471ebed597c01710a557 2023-02-13 12:01:22,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 12:01:22,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 12:01:22,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): eae16532ffbd025a3daf5e7ea3cea6e8/family1 is initiating minor compaction (all files) 2023-02-13 12:01:22,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@76acd046; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:22,683 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of eae16532ffbd025a3daf5e7ea3cea6e8/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:22,685 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/914c656696e945c99f7dee9c990dd427, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/df7489fa55c646248748569a00dd72b7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/7a9efc867d2a49449b0053c581d6a76c_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp, totalSize=358.6 K 2023-02-13 12:01:22,686 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 914c656696e945c99f7dee9c990dd427, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807319 2023-02-13 12:01:22,687 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting df7489fa55c646248748569a00dd72b7, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207319 2023-02-13 12:01:22,688 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 7a9efc867d2a49449b0053c581d6a76c_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878807319 2023-02-13 12:01:22,688 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:22,689 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:22,691 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511309c467f52a9fc4c009d525b632646c284 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511309c467f52a9fc4c009d525b632646c284 2023-02-13 12:01:22,692 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201bd6997a9f3284128ba82f0237c51f952 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201bd6997a9f3284128ba82f0237c51f952 2023-02-13 12:01:22,694 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512051437e22cac614b1b914386c8d5d6871b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512051437e22cac614b1b914386c8d5d6871b 2023-02-13 12:01:22,694 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-13 12:01:22,694 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 12:01:22,695 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:22,695 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:22,695 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:01:22,696 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 12:01:22,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0750 sec 2023-02-13 12:01:22,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/242c8b01af894c98997f533c07d42106, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/d5c3c9cf39854b6ba1c4a4c05d08970b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/6437163ea2d64182ac9e239edae1958f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c732b7092dae40808d240755b6e439fb, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c881a71b18b14a839ac20fe9468a268c, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/eb2aed50f3004c3bb9e3c9f2b29b6a49, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/cfce3883a04b4c3f91963220c58bbdb3, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/4109bd48f4204dbea4de3f2381bd9355, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/a168aa9dbf3d4bc59f6a69cea9102912, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/00b05050243741be931b89f26480839a_SeqId_44_] to archive 2023-02-13 12:01:22,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:22,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/242c8b01af894c98997f533c07d42106 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/242c8b01af894c98997f533c07d42106 2023-02-13 12:01:22,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/d5c3c9cf39854b6ba1c4a4c05d08970b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/d5c3c9cf39854b6ba1c4a4c05d08970b 2023-02-13 12:01:22,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/6437163ea2d64182ac9e239edae1958f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/6437163ea2d64182ac9e239edae1958f 2023-02-13 12:01:22,741 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): eae16532ffbd025a3daf5e7ea3cea6e8#family1#compaction#11 average throughput is 4.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:01:22,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c732b7092dae40808d240755b6e439fb to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c732b7092dae40808d240755b6e439fb 2023-02-13 12:01:22,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c881a71b18b14a839ac20fe9468a268c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/c881a71b18b14a839ac20fe9468a268c 2023-02-13 12:01:22,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/eb2aed50f3004c3bb9e3c9f2b29b6a49 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/eb2aed50f3004c3bb9e3c9f2b29b6a49 2023-02-13 12:01:22,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/cfce3883a04b4c3f91963220c58bbdb3 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/cfce3883a04b4c3f91963220c58bbdb3 2023-02-13 12:01:22,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/4109bd48f4204dbea4de3f2381bd9355 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/4109bd48f4204dbea4de3f2381bd9355 2023-02-13 12:01:22,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/a168aa9dbf3d4bc59f6a69cea9102912 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/a168aa9dbf3d4bc59f6a69cea9102912 2023-02-13 12:01:22,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/00b05050243741be931b89f26480839a_SeqId_44_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/00b05050243741be931b89f26480839a_SeqId_44_ 2023-02-13 12:01:22,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 12:01:22,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:23,289 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 12:01:23,294 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 12:01:23,294 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 12:01:23,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-13 12:01:23,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=eae16532ffbd025a3daf5e7ea3cea6e8, REOPEN/MOVE}] 2023-02-13 12:01:23,315 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=eae16532ffbd025a3daf5e7ea3cea6e8, REOPEN/MOVE 2023-02-13 12:01:23,315 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=eae16532ffbd025a3daf5e7ea3cea6e8, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:23,316 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676289683315"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289683315"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289683315"}]},"ts":"1676289683315"} 2023-02-13 12:01:23,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure eae16532ffbd025a3daf5e7ea3cea6e8, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:23,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:23,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing eae16532ffbd025a3daf5e7ea3cea6e8, disabling compactions & flushes 2023-02-13 12:01:23,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:23,587 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/.tmp/family1/0d21d89e6a164c10bed94233d278318d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/0d21d89e6a164c10bed94233d278318d 2023-02-13 12:01:23,594 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in eae16532ffbd025a3daf5e7ea3cea6e8/family1 of eae16532ffbd025a3daf5e7ea3cea6e8 into 0d21d89e6a164c10bed94233d278318d(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:01:23,594 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:23,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:23,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:23,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. after waiting 0 ms 2023-02-13 12:01:23,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:23,594 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1676289682683; duration=0sec 2023-02-13 12:01:23,594 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:23,597 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/914c656696e945c99f7dee9c990dd427, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/df7489fa55c646248748569a00dd72b7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/7a9efc867d2a49449b0053c581d6a76c_SeqId_47_] to archive 2023-02-13 12:01:23,598 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:23,600 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/914c656696e945c99f7dee9c990dd427 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/914c656696e945c99f7dee9c990dd427 2023-02-13 12:01:23,601 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/df7489fa55c646248748569a00dd72b7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/df7489fa55c646248748569a00dd72b7 2023-02-13 12:01:23,603 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/7a9efc867d2a49449b0053c581d6a76c_SeqId_47_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/7a9efc867d2a49449b0053c581d6a76c_SeqId_47_ 2023-02-13 12:01:23,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 12:01:23,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:23,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for eae16532ffbd025a3daf5e7ea3cea6e8: Waiting for close lock at 1676289683477Running coprocessor pre-close hooks at 1676289683477Disabling compacts and flushes for region at 1676289683477Disabling writes for close at 1676289683594 (+117 ms)Writing region close event to WAL at 1676289683606 (+12 ms)Running coprocessor post-close hooks at 1676289683611 (+5 ms)Closed at 1676289683612 (+1 ms) 2023-02-13 12:01:23,612 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: eae16532ffbd025a3daf5e7ea3cea6e8 to self. 2023-02-13 12:01:23,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:23,614 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=eae16532ffbd025a3daf5e7ea3cea6e8, regionState=CLOSED 2023-02-13 12:01:23,615 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676289683614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289683614"}]},"ts":"1676289683614"} 2023-02-13 12:01:23,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 12:01:23,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure eae16532ffbd025a3daf5e7ea3cea6e8, server=jenkins-hbase16.apache.org,39857,1676289663697 in 298 msec 2023-02-13 12:01:23,620 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=eae16532ffbd025a3daf5e7ea3cea6e8, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=true 2023-02-13 12:01:23,770 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=eae16532ffbd025a3daf5e7ea3cea6e8, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:23,771 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676289683770"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289683770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289683770"}]},"ts":"1676289683770"} 2023-02-13 12:01:23,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure eae16532ffbd025a3daf5e7ea3cea6e8, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:23,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:23,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eae16532ffbd025a3daf5e7ea3cea6e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:01:23,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:23,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:23,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:23,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:23,938 INFO [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:23,940 DEBUG [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:23,941 DEBUG [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:23,941 INFO [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eae16532ffbd025a3daf5e7ea3cea6e8 columnFamilyName family1 2023-02-13 12:01:23,954 DEBUG [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/0d21d89e6a164c10bed94233d278318d 2023-02-13 12:01:23,955 INFO [StoreOpener-eae16532ffbd025a3daf5e7ea3cea6e8-1] regionserver.HStore(310): Store=eae16532ffbd025a3daf5e7ea3cea6e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:23,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:23,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:23,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:01:23,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened eae16532ffbd025a3daf5e7ea3cea6e8; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63488249, jitterRate=-0.05395136773586273}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:01:23,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for eae16532ffbd025a3daf5e7ea3cea6e8: Running coprocessor pre-open hook at 1676289683936Writing region info on filesystem at 1676289683936Initializing all the Stores at 1676289683938 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676289683938Cleaning up temporary data from old regions at 1676289683958 (+20 ms)Cleaning up detritus from prior splits at 1676289683959 (+1 ms)Running coprocessor post-open hooks at 1676289683962 (+3 ms)Region opened successfully at 1676289683962 2023-02-13 12:01:23,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8., pid=17, masterSystemTime=1676289683929 2023-02-13 12:01:23,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:23,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:01:23,965 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=eae16532ffbd025a3daf5e7ea3cea6e8, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:23,965 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676289683965"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289683965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289683965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289683965"}]},"ts":"1676289683965"} 2023-02-13 12:01:23,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-13 12:01:23,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure eae16532ffbd025a3daf5e7ea3cea6e8, server=jenkins-hbase16.apache.org,39857,1676289663697 in 193 msec 2023-02-13 12:01:23,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-13 12:01:23,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=eae16532ffbd025a3daf5e7ea3cea6e8, REOPEN/MOVE in 656 msec 2023-02-13 12:01:23,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-13 12:01:23,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 675 msec 2023-02-13 12:01:23,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.1120 sec 2023-02-13 12:01:23,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-13 12:01:23,991 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(278): alter status finished 2023-02-13 12:01:23,992 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 12:01:23,994 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 12:01:23,995 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 12:01:23,996 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:01:23,996 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290283996 2023-02-13 12:01:23,997 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:01:23,998 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 12:01:23,998 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:23,998 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x35cbada1 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:01:24,033 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@111cf9c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:01:24,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:24,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:24,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:24,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:24,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:24,878 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287e8f9d91d82643a79aa8a3727024e2af to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287e8f9d91d82643a79aa8a3727024e2af 2023-02-13 12:01:24,880 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:24,894 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:01:24,895 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:38926, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:01:24,903 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:01:24,906 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36276, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:01:24,918 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dbc4f6b3e3bd47bda30fc5d066c75a0d first=Optional[r05] last=Optional[r8] 2023-02-13 12:01:24,919 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dbc4f6b3e3bd47bda30fc5d066c75a0d}] 2023-02-13 12:01:24,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dbc4f6b3e3bd47bda30fc5d066c75a0d for inclusion in eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:24,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 12:01:24,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:01:24,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for eae16532ffbd025a3daf5e7ea3cea6e8: 2023-02-13 12:01:24,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dbc4f6b3e3bd47bda30fc5d066c75a0d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oj0afufjo239kefvjv6iopq23unjmcsak0iotha6o6vq21vu245j0j8qbgh0v40f/family1/dbc4f6b3e3bd47bda30fc5d066c75a0d 2023-02-13 12:01:24,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oj0afufjo239kefvjv6iopq23unjmcsak0iotha6o6vq21vu245j0j8qbgh0v40f/family1/dbc4f6b3e3bd47bda30fc5d066c75a0d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/9158c9af0e1a416abdbbbb58dea233fa_SeqId_53_ 2023-02-13 12:01:24,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oj0afufjo239kefvjv6iopq23unjmcsak0iotha6o6vq21vu245j0j8qbgh0v40f/family1/dbc4f6b3e3bd47bda30fc5d066c75a0d into eae16532ffbd025a3daf5e7ea3cea6e8/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/9158c9af0e1a416abdbbbb58dea233fa_SeqId_53_ - updating store file list. 2023-02-13 12:01:24,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/9158c9af0e1a416abdbbbb58dea233fa_SeqId_53_ into eae16532ffbd025a3daf5e7ea3cea6e8/family1 2023-02-13 12:01:24,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oj0afufjo239kefvjv6iopq23unjmcsak0iotha6o6vq21vu245j0j8qbgh0v40f/family1/dbc4f6b3e3bd47bda30fc5d066c75a0d into eae16532ffbd025a3daf5e7ea3cea6e8/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/family1/9158c9af0e1a416abdbbbb58dea233fa_SeqId_53_) 2023-02-13 12:01:24,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oj0afufjo239kefvjv6iopq23unjmcsak0iotha6o6vq21vu245j0j8qbgh0v40f/family1/dbc4f6b3e3bd47bda30fc5d066c75a0d 2023-02-13 12:01:24,943 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:24,944 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:24,946 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511201eeaaeba91624f25830b97b4c9286f18 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511201eeaaeba91624f25830b97b4c9286f18 2023-02-13 12:01:24,947 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c01a739da2264b7eabb8dcdfe1af10bb to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c01a739da2264b7eabb8dcdfe1af10bb 2023-02-13 12:01:24,947 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-13 12:01:24,947 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 12:01:24,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:24,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:24,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 12:01:24,948 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 12:01:24,948 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:01:24,949 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 12:01:24,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 956 msec 2023-02-13 12:01:25,042 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=245 (was 209) Potentially hanging thread: hconnection-0x306915e5-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37984 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62284@0x35cbada1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/97546656.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37880 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:38024 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ce11d39-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62284@0x61534e27-SendThread(127.0.0.1:62284) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:45782 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37920 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:38040 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:45754 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62284@0x61534e27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/97546656.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x306915e5-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3ce11d39-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37974 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-207202794_15 at /127.0.0.1:37960 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37874 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37862 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37884 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x306915e5-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase16:39857-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62284@0x35cbada1-SendThread(127.0.0.1:62284) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37942 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62284@0x61534e27-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37900 [Waiting for operation #26] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62284@0x35cbada1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37940 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:37968 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=590 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=268 (was 322), ProcessCount=167 (was 169), AvailableMemoryMB=4725 (was 4839) 2023-02-13 12:01:25,054 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=245, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=268, ProcessCount=167, AvailableMemoryMB=4724 2023-02-13 12:01:25,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 12:01:25,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:25,059 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:01:25,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-13 12:01:25,061 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:01:25,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 12:01:25,062 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:01:25,063 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31 empty. 2023-02-13 12:01:25,063 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:01:25,064 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-13 12:01:25,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 12:01:25,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 12:01:25,474 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 12:01:25,476 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => aab7fec0138e275e2b59795c7bfb8a31, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:01:25,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 12:01:25,900 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:25,900 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing aab7fec0138e275e2b59795c7bfb8a31, disabling compactions & flushes 2023-02-13 12:01:25,900 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:25,901 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:25,901 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. after waiting 0 ms 2023-02-13 12:01:25,901 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:25,901 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:25,901 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for aab7fec0138e275e2b59795c7bfb8a31: Waiting for close lock at 1676289685900Disabling compacts and flushes for region at 1676289685900Disabling writes for close at 1676289685901 (+1 ms)Writing region close event to WAL at 1676289685901Closed at 1676289685901 2023-02-13 12:01:25,906 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:01:25,907 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676289685907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289685907"}]},"ts":"1676289685907"} 2023-02-13 12:01:25,910 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 12:01:25,911 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:01:25,912 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289685911"}]},"ts":"1676289685911"} 2023-02-13 12:01:25,913 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 12:01:25,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=aab7fec0138e275e2b59795c7bfb8a31, ASSIGN}] 2023-02-13 12:01:25,959 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=aab7fec0138e275e2b59795c7bfb8a31, ASSIGN 2023-02-13 12:01:25,960 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=aab7fec0138e275e2b59795c7bfb8a31, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:01:26,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=aab7fec0138e275e2b59795c7bfb8a31, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:26,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676289686111"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289686111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289686111"}]},"ts":"1676289686111"} 2023-02-13 12:01:26,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure aab7fec0138e275e2b59795c7bfb8a31, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:26,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 12:01:26,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:26,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aab7fec0138e275e2b59795c7bfb8a31, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:01:26,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:01:26,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:26,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:01:26,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:01:26,278 INFO [StoreOpener-aab7fec0138e275e2b59795c7bfb8a31-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:01:26,280 DEBUG [StoreOpener-aab7fec0138e275e2b59795c7bfb8a31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1 2023-02-13 12:01:26,281 DEBUG [StoreOpener-aab7fec0138e275e2b59795c7bfb8a31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1 2023-02-13 12:01:26,282 INFO [StoreOpener-aab7fec0138e275e2b59795c7bfb8a31-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aab7fec0138e275e2b59795c7bfb8a31 columnFamilyName family1 2023-02-13 12:01:26,284 INFO [StoreOpener-aab7fec0138e275e2b59795c7bfb8a31-1] regionserver.HStore(310): Store=aab7fec0138e275e2b59795c7bfb8a31/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:26,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:01:26,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:01:26,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:01:26,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:01:26,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened aab7fec0138e275e2b59795c7bfb8a31; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66157897, jitterRate=-0.014170512557029724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:01:26,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for aab7fec0138e275e2b59795c7bfb8a31: Running coprocessor pre-open hook at 1676289686275Writing region info on filesystem at 1676289686275Initializing all the Stores at 1676289686277 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676289686277Cleaning up temporary data from old regions at 1676289686286 (+9 ms)Cleaning up detritus from prior splits at 1676289686286Running coprocessor post-open hooks at 1676289686291 (+5 ms)Region opened successfully at 1676289686291 2023-02-13 12:01:26,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31., pid=21, masterSystemTime=1676289686265 2023-02-13 12:01:26,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:26,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:26,294 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=aab7fec0138e275e2b59795c7bfb8a31, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:26,294 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676289686294"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289686294"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289686294"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289686294"}]},"ts":"1676289686294"} 2023-02-13 12:01:26,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-13 12:01:26,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure aab7fec0138e275e2b59795c7bfb8a31, server=jenkins-hbase16.apache.org,39857,1676289663697 in 182 msec 2023-02-13 12:01:26,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-13 12:01:26,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=aab7fec0138e275e2b59795c7bfb8a31, ASSIGN in 340 msec 2023-02-13 12:01:26,300 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:01:26,300 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289686300"}]},"ts":"1676289686300"} 2023-02-13 12:01:26,301 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 12:01:26,334 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:01:26,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2780 sec 2023-02-13 12:01:27,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 12:01:27,170 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-13 12:01:27,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:27,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:27,205 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:27,205 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:27,205 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:27,206 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:27,206 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:27,206 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:27,237 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:27,238 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:27,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:27,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:27,238 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:27,238 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:27,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:27,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:27,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:27,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:27,239 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:27,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:27,240 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:27,240 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:27,240 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:27,241 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:27,241 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:27,241 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:27,241 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:27,241 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 12:01:27,681 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306ac97829843949219643fa5f6202a425 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511306ac97829843949219643fa5f6202a425 2023-02-13 12:01:28,088 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/f0654331113d4c2ca5fd32965f301a99 2023-02-13 12:01:28,103 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/f0654331113d4c2ca5fd32965f301a99 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f0654331113d4c2ca5fd32965f301a99 2023-02-13 12:01:28,111 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f0654331113d4c2ca5fd32965f301a99, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 12:01:28,112 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 871ms, sequenceid=5, compaction requested=false 2023-02-13 12:01:28,112 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:28,113 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:28,113 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:28,114 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:28,114 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:28,114 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,114 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:28,114 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:28,238 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,238 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:28,239 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,239 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:28,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:28,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6942b53d[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:28,245 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:28,245 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,254 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,254 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:28,254 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:28,254 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:28,255 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,255 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:28,265 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,265 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:28,265 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:28,265 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:28,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:28,269 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:28,269 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:28,270 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:28,270 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,270 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:28,279 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,279 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,279 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:28,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:28,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:28,280 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:28,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:28,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:28,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:28,283 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:28,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,296 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,296 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,296 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,296 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:28,296 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:28,296 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:28,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:28,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:28,296 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:28,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:28,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:01:28,297 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,297 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:28,297 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,297 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:28,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:28,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:28,298 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,398 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:28,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:28,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:28,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:28,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,413 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:28,414 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:28,414 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:28,414 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:28,415 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,415 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,423 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,423 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:28,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:28,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:28,424 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:28,424 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:28,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,425 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:01:28,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:28,425 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:28,425 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:28,426 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:28,426 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:28,426 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:28,426 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:28,426 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:28,426 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 12:01:28,848 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128328a8447b36c4900a61e4a4684f994bd to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128328a8447b36c4900a61e4a4684f994bd 2023-02-13 12:01:29,145 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:01:29,256 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/0e40f59d696c46a9a72ad6d5fb50d562 2023-02-13 12:01:29,267 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/0e40f59d696c46a9a72ad6d5fb50d562 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/0e40f59d696c46a9a72ad6d5fb50d562 2023-02-13 12:01:29,274 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/0e40f59d696c46a9a72ad6d5fb50d562, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 12:01:29,275 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 849ms, sequenceid=9, compaction requested=false 2023-02-13 12:01:29,275 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:29,275 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:29,275 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:29,275 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:29,275 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,275 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:29,276 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:29,307 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,307 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:29,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:29,308 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,308 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:29,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:29,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:29,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:29,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:29,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aebd4c9[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:29,313 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:29,313 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,323 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,324 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:29,324 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:29,324 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:29,324 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,324 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:29,332 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,332 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:29,332 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:29,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:29,332 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:29,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:29,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:29,337 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:29,338 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:29,338 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:29,338 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,338 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:29,348 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,348 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,348 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:29,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:29,349 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,350 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,378 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,378 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,378 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,378 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:29,378 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:29,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:01:29,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:29,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:29,378 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:29,379 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:29,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:29,379 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,380 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:29,380 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,380 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:29,380 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:29,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:29,480 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:29,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:29,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:29,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:29,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,496 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:29,496 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:29,496 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:29,496 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:29,497 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,497 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,507 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,507 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:29,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:29,507 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:29,507 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:29,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,508 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,508 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:01:29,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:29,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:29,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:29,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:29,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:29,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:29,509 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:29,509 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:29,509 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:29,940 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015b7ce067737b461993f02ec382191047 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512015b7ce067737b461993f02ec382191047 2023-02-13 12:01:30,349 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/1681c827672d46f591e285cd522cb490 2023-02-13 12:01:30,363 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/1681c827672d46f591e285cd522cb490 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1681c827672d46f591e285cd522cb490 2023-02-13 12:01:30,368 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1681c827672d46f591e285cd522cb490, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 12:01:30,369 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 860ms, sequenceid=13, compaction requested=true 2023-02-13 12:01:30,369 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:30,369 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:30,369 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:30,370 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:30,370 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,370 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:30,370 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:30,412 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,412 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:30,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:30,413 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,413 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:30,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:30,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:30,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:30,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:30,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58c77a0b[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:30,416 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:30,416 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,423 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,424 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:30,424 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:30,424 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:30,424 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,424 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:30,432 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:30,432 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:30,432 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:30,432 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:30,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:30,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:30,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:30,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:30,440 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:30,441 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:30,441 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:30,441 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,441 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:30,448 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,448 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:30,448 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:30,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:30,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:30,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:30,449 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:30,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:30,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,450 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:30,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,456 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,456 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:30,456 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,456 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:30,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:30,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:30,456 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:30,457 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:01:30,457 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:30,457 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:30,457 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,457 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,458 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,457 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:30,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:30,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:30,558 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:30,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:30,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:30,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:30,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,574 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:30,574 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:30,575 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:30,575 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:30,575 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,575 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,581 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:30,581 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:30,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:30,582 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:30,582 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:30,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,583 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,584 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:01:30,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:30,584 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:30,584 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:30,584 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:30,585 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:30,585 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:30,585 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:30,585 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:30,585 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:31,004 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120533796f3398434b80b8d95945403ba169 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120533796f3398434b80b8d95945403ba169 2023-02-13 12:01:31,412 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/8e7acc2f8bc24cebbf874c3d637ca8c2 2023-02-13 12:01:31,425 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/8e7acc2f8bc24cebbf874c3d637ca8c2 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/8e7acc2f8bc24cebbf874c3d637ca8c2 2023-02-13 12:01:31,432 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/8e7acc2f8bc24cebbf874c3d637ca8c2, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 12:01:31,433 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 848ms, sequenceid=17, compaction requested=true 2023-02-13 12:01:31,433 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:31,433 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:31,433 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:31,434 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:31,434 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,434 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:31,434 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:31,465 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,465 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:31,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:31,466 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,466 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:31,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:31,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:31,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:31,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:31,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58d7efce[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:31,471 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:31,471 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,482 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:31,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:31,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:31,483 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,483 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:31,490 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:31,490 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:31,490 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:31,490 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:31,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:31,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:31,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:31,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:31,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:31,499 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:31,499 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:31,499 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:31,499 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,499 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:31,507 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,507 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,507 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:31,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:31,508 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,512 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,524 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:31,524 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,524 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:31,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:01:31,524 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,525 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:31,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:31,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:31,524 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:31,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:31,525 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,526 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:31,526 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,526 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:31,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:31,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:31,527 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,627 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:31,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:31,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:31,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:31,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,641 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:31,641 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:31,642 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:31,642 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:31,643 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,643 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,654 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,654 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:31,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:31,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:31,655 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:31,655 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:31,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:31,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,655 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:01:31,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:31,656 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:31,656 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:31,656 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:31,656 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:31,656 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:31,656 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:31,657 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:31,657 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:32,081 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282ce26686f8f440438b6d64ed2efb4f23 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512282ce26686f8f440438b6d64ed2efb4f23 2023-02-13 12:01:32,490 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/4465b8efe91349adbcf0459e14845119 2023-02-13 12:01:32,503 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/4465b8efe91349adbcf0459e14845119 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/4465b8efe91349adbcf0459e14845119 2023-02-13 12:01:32,510 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/4465b8efe91349adbcf0459e14845119, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 12:01:32,511 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 854ms, sequenceid=21, compaction requested=true 2023-02-13 12:01:32,511 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:32,511 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:32,511 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:32,511 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:32,511 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,511 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:32,512 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:32,540 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,540 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:32,541 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,541 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:32,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:32,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:32,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:32,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@244042b4[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:32,545 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:32,545 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,554 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,555 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:32,555 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:32,555 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:32,555 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,555 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:32,565 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:32,565 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:32,565 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:32,565 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:32,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:32,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:32,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:32,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:32,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:32,573 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:32,574 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:32,574 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:32,574 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,574 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:32,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,605 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,605 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:32,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:32,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:32,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:32,606 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,609 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,623 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,623 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:32,623 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:32,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:32,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:32,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:32,623 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:32,623 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,624 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,623 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:32,624 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:01:32,624 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:32,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:32,624 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:32,624 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,625 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:32,725 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:32,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:32,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:32,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:32,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,739 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:32,740 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:32,740 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:32,740 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:32,741 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,741 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,748 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,748 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:32,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:32,749 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:32,749 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:32,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,752 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,752 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:01:32,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:32,752 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:32,752 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:32,753 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:32,754 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:32,754 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:32,754 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:32,754 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:32,754 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:33,180 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231095e5e60868c42e591a5431bf64886f5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231095e5e60868c42e591a5431bf64886f5 2023-02-13 12:01:33,588 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/824913080cfe4965925702e77c6850bf 2023-02-13 12:01:33,602 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/824913080cfe4965925702e77c6850bf as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/824913080cfe4965925702e77c6850bf 2023-02-13 12:01:33,607 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/824913080cfe4965925702e77c6850bf, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 12:01:33,608 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 854ms, sequenceid=25, compaction requested=true 2023-02-13 12:01:33,608 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:33,608 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:33,608 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:33,609 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:33,609 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,609 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:33,609 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:33,640 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,640 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:33,640 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,640 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:33,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:33,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:33,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:33,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:33,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50f98769[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:33,643 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:33,643 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,648 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,648 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:33,648 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:33,648 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:33,649 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,649 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:33,656 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:33,656 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:33,656 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:33,656 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:33,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:33,659 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:33,660 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:33,660 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:33,660 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,660 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:33,665 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,665 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:33,665 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,665 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:33,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,666 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:33,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:33,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:33,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:33,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:33,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,673 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:33,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:01:33,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,674 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,674 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,674 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:33,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:33,674 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:33,774 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:33,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:33,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:33,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:33,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,788 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:33,788 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:33,789 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:33,789 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:33,790 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,790 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,798 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:33,798 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:33,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:33,799 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:33,799 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:33,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,802 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,803 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:01:33,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:33,803 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:33,803 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:33,804 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:33,804 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:33,804 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:33,805 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:33,805 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:33,805 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:34,233 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010139d57384ab454c78b0b626adc938a48f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010139d57384ab454c78b0b626adc938a48f 2023-02-13 12:01:34,642 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/e3e8f5a1c4ec4061a832c4837d582871 2023-02-13 12:01:34,655 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/e3e8f5a1c4ec4061a832c4837d582871 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e3e8f5a1c4ec4061a832c4837d582871 2023-02-13 12:01:34,664 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e3e8f5a1c4ec4061a832c4837d582871, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 12:01:34,666 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 861ms, sequenceid=29, compaction requested=true 2023-02-13 12:01:34,666 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:34,666 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:34,666 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:34,666 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:34,666 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,666 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:34,666 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:34,698 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,698 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:34,699 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,699 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:34,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:34,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:34,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:34,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:34,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@330db85f[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:34,702 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:34,702 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,712 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,713 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:34,713 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:34,713 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:34,713 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,713 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:34,723 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:34,723 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:34,723 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,723 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:34,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:34,734 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:34,734 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:34,734 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:34,734 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,734 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:34,746 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,746 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,746 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:34,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:34,747 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:34,751 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,762 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,762 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:34,762 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:34,762 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:34,762 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,762 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,763 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:34,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:34,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:34,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:01:34,763 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:34,764 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:34,764 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:34,763 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,764 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:34,864 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:34,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:34,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:34,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:34,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,881 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:34,881 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:34,882 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:34,882 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:34,882 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,883 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,890 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:34,890 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:34,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:34,890 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:34,891 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:34,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,892 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,892 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:01:34,892 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:34,892 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:34,892 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:34,893 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:34,893 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:34,893 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:34,893 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:34,893 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:34,893 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:35,320 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f2ba926b4e8a4ab4bc5577d97999c78f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f2ba926b4e8a4ab4bc5577d97999c78f 2023-02-13 12:01:35,729 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/c89e8ec8c5324ae5b915cce04b59d878 2023-02-13 12:01:35,743 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/c89e8ec8c5324ae5b915cce04b59d878 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/c89e8ec8c5324ae5b915cce04b59d878 2023-02-13 12:01:35,752 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/c89e8ec8c5324ae5b915cce04b59d878, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 12:01:35,753 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 860ms, sequenceid=33, compaction requested=true 2023-02-13 12:01:35,753 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:35,753 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:35,753 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:35,753 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:35,753 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,754 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:35,754 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:35,781 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,781 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:35,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:35,782 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,782 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:35,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:35,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:35,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:35,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:35,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54c3986f[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:35,787 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:35,787 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,821 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,822 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:35,822 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:35,822 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:35,822 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,822 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:35,837 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:35,837 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,837 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:35,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:35,837 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:35,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:35,841 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:35,841 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:35,841 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:35,841 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,841 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:35,848 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,848 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:35,848 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:35,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:35,849 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:35,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,850 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,856 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,856 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:35,856 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,857 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:01:35,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:35,856 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:35,857 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:35,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:35,857 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:35,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:35,857 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:35,858 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:35,858 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:35,858 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,858 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,958 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:35,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:35,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:35,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:35,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,976 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:35,976 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:35,977 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:35,977 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:35,977 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,978 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,987 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,987 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:35,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:35,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:35,988 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:35,988 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:35,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:35,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,991 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,991 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:01:35,991 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:35,991 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:35,991 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:35,992 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:35,993 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:35,993 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:35,993 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:35,993 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:35,993 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:36,417 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077a322aedf46e432b93bf236830a2d329 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509077a322aedf46e432b93bf236830a2d329 2023-02-13 12:01:36,823 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/f7dfd7f1132a4bcb9e257ae4d6c16ddc 2023-02-13 12:01:36,830 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/f7dfd7f1132a4bcb9e257ae4d6c16ddc as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f7dfd7f1132a4bcb9e257ae4d6c16ddc 2023-02-13 12:01:36,835 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f7dfd7f1132a4bcb9e257ae4d6c16ddc, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 12:01:36,836 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 843ms, sequenceid=37, compaction requested=true 2023-02-13 12:01:36,836 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:36,836 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:36,836 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:36,836 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:36,836 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,836 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:36,836 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:36,865 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,865 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:36,865 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,865 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:36,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:36,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:36,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@723035a1[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:36,869 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:36,869 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,879 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,879 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:36,880 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:36,880 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:36,880 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,880 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:36,890 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:36,890 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:36,890 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,890 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:36,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:36,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:36,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:36,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:36,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:36,897 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:36,897 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:36,897 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:36,897 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,897 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:36,906 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,906 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:36,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,906 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:36,907 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,908 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:36,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,914 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,915 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,915 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:36,915 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:36,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:36,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:36,915 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:36,915 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:36,915 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:36,916 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:36,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:36,915 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:36,916 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,916 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,916 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:36,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:37,016 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:37,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:37,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:37,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:37,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,034 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:37,034 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:37,035 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:01:37,035 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:37,036 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,036 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,046 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:37,046 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:37,047 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,047 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:37,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,048 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:01:37,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,049 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:01:37,049 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:37,051 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:01:37,051 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:37,051 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:37,051 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:37,051 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. started... 2023-02-13 12:01:37,051 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aab7fec0138e275e2b59795c7bfb8a31 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:37,482 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201b6edf4c4de0440b80450359e9f2dcfc to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201b6edf4c4de0440b80450359e9f2dcfc 2023-02-13 12:01:37,890 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/305938de050f45218037e53c605e6eb8 2023-02-13 12:01:37,897 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/305938de050f45218037e53c605e6eb8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/305938de050f45218037e53c605e6eb8 2023-02-13 12:01:37,904 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/305938de050f45218037e53c605e6eb8, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 12:01:37,905 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aab7fec0138e275e2b59795c7bfb8a31 in 854ms, sequenceid=41, compaction requested=true 2023-02-13 12:01:37,905 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:37,905 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:37,905 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:37,905 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:37,905 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,905 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:01:37,905 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:01:37,915 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,915 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:37,915 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,915 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:01:37,917 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e6e3641[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:37,917 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,931 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,932 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:37,932 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,932 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:37,932 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:01:37,932 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:37,940 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,940 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:01:37,940 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:37,940 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:01:37,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:37,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:37,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:37,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:37,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:37,948 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:01:37,948 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:37,948 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:37,948 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,948 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:37,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:37,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:37,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:37,957 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:37,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,958 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,965 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:37,965 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 12:01:37,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:37,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:37,965 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:37,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:01:37,965 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:37,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:37,965 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:37,965 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,967 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:37,967 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:37,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:37,967 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:37,967 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,967 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:37,967 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:38,067 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:38,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:38,071 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-13 12:01:38,075 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:01:38,076 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:01:38,078 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:01:38,078 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290298078 2023-02-13 12:01:38,079 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:01:38,080 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 12:01:38,081 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:01:38,081 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x62dd8dda to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:01:38,091 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1479b2b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:01:38,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:01:38,560 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032331a5814eb24ab8beb576e448506bba to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601032331a5814eb24ab8beb576e448506bba 2023-02-13 12:01:38,561 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:01:38,574 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:01:38,575 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:52322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:01:38,583 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:01:38,584 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45294, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:01:38,596 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7dd03dd6d0104c03bd9d652949c3e46f first=Optional[r5] last=Optional[r6] 2023-02-13 12:01:38,596 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7dd03dd6d0104c03bd9d652949c3e46f}] 2023-02-13 12:01:38,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7dd03dd6d0104c03bd9d652949c3e46f for inclusion in aab7fec0138e275e2b59795c7bfb8a31/family1 2023-02-13 12:01:38,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 12:01:38,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:01:38,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:38,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7dd03dd6d0104c03bd9d652949c3e46f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__baiamlk2n67dd56tfdkv5nhd9avl795t6ec170vama4a7337kjrttaj05mh6k7dd/family1/7dd03dd6d0104c03bd9d652949c3e46f 2023-02-13 12:01:38,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__baiamlk2n67dd56tfdkv5nhd9avl795t6ec170vama4a7337kjrttaj05mh6k7dd/family1/7dd03dd6d0104c03bd9d652949c3e46f as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e397dd97baf04da680c1fd67420d09fe_SeqId_44_ 2023-02-13 12:01:38,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__baiamlk2n67dd56tfdkv5nhd9avl795t6ec170vama4a7337kjrttaj05mh6k7dd/family1/7dd03dd6d0104c03bd9d652949c3e46f into aab7fec0138e275e2b59795c7bfb8a31/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e397dd97baf04da680c1fd67420d09fe_SeqId_44_ - updating store file list. 2023-02-13 12:01:38,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e397dd97baf04da680c1fd67420d09fe_SeqId_44_ into aab7fec0138e275e2b59795c7bfb8a31/family1 2023-02-13 12:01:38,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__baiamlk2n67dd56tfdkv5nhd9avl795t6ec170vama4a7337kjrttaj05mh6k7dd/family1/7dd03dd6d0104c03bd9d652949c3e46f into aab7fec0138e275e2b59795c7bfb8a31/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e397dd97baf04da680c1fd67420d09fe_SeqId_44_) 2023-02-13 12:01:38,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__baiamlk2n67dd56tfdkv5nhd9avl795t6ec170vama4a7337kjrttaj05mh6k7dd/family1/7dd03dd6d0104c03bd9d652949c3e46f 2023-02-13 12:01:38,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 12:01:38,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 12:01:38,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): aab7fec0138e275e2b59795c7bfb8a31/family1 is initiating minor compaction 2023-02-13 12:01:38,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6f408532; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:38,619 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of aab7fec0138e275e2b59795c7bfb8a31/family1 in testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:38,619 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/0e40f59d696c46a9a72ad6d5fb50d562, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1681c827672d46f591e285cd522cb490, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/8e7acc2f8bc24cebbf874c3d637ca8c2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/4465b8efe91349adbcf0459e14845119, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/824913080cfe4965925702e77c6850bf, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e3e8f5a1c4ec4061a832c4837d582871, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/c89e8ec8c5324ae5b915cce04b59d878, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f7dfd7f1132a4bcb9e257ae4d6c16ddc, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/305938de050f45218037e53c605e6eb8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e397dd97baf04da680c1fd67420d09fe_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp, totalSize=49.7 K 2023-02-13 12:01:38,619 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 0e40f59d696c46a9a72ad6d5fb50d562, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 12:01:38,619 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 1681c827672d46f591e285cd522cb490, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 12:01:38,619 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 8e7acc2f8bc24cebbf874c3d637ca8c2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 12:01:38,619 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 4465b8efe91349adbcf0459e14845119, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 12:01:38,620 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 824913080cfe4965925702e77c6850bf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 12:01:38,620 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting e3e8f5a1c4ec4061a832c4837d582871, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 12:01:38,620 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting c89e8ec8c5324ae5b915cce04b59d878, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 12:01:38,620 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting f7dfd7f1132a4bcb9e257ae4d6c16ddc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 12:01:38,620 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 305938de050f45218037e53c605e6eb8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 12:01:38,620 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting e397dd97baf04da680c1fd67420d09fe_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 12:01:38,622 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:01:38,623 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:38,625 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010139d57384ab454c78b0b626adc938a48f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010139d57384ab454c78b0b626adc938a48f 2023-02-13 12:01:38,626 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f2ba926b4e8a4ab4bc5577d97999c78f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f2ba926b4e8a4ab4bc5577d97999c78f 2023-02-13 12:01:38,627 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 12:01:38,627 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 12:01:38,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:01:38,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:01:38,729 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): aab7fec0138e275e2b59795c7bfb8a31#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:01:38,825 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:01:38,825 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61534e27 to 127.0.0.1:62284 2023-02-13 12:01:38,825 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:01:38,826 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:01:38,827 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35cbada1 to 127.0.0.1:62284 2023-02-13 12:01:38,827 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:01:39,550 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b59739c383654453a905f2a399fe42ee to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231b59739c383654453a905f2a399fe42ee 2023-02-13 12:01:39,550 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/d57eb948f1c44912bc5a22bc6ab247ee as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/d57eb948f1c44912bc5a22bc6ab247ee 2023-02-13 12:01:39,551 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:01:39,557 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in aab7fec0138e275e2b59795c7bfb8a31/family1 of aab7fec0138e275e2b59795c7bfb8a31 into d57eb948f1c44912bc5a22bc6ab247ee(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:01:39,557 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:39,557 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676289698618; duration=0sec 2023-02-13 12:01:39,557 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:39,576 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3c839992c9424573ba3a8f08f22fc123 first=Optional[r1] last=Optional[r4] 2023-02-13 12:01:39,577 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3c839992c9424573ba3a8f08f22fc123}] 2023-02-13 12:01:39,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3c839992c9424573ba3a8f08f22fc123 for inclusion in aab7fec0138e275e2b59795c7bfb8a31/family1 2023-02-13 12:01:39,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 12:01:39,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:01:39,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:39,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3c839992c9424573ba3a8f08f22fc123 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gfv3gbn9sp5ipcfuqni3teocfid2bm7b0j6d8cnugcafqp3eo5pmdlp19h4j9g7b/family1/3c839992c9424573ba3a8f08f22fc123 2023-02-13 12:01:39,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gfv3gbn9sp5ipcfuqni3teocfid2bm7b0j6d8cnugcafqp3eo5pmdlp19h4j9g7b/family1/3c839992c9424573ba3a8f08f22fc123 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1f1f4999e68e4f4fa8702ab46eb55768_SeqId_47_ 2023-02-13 12:01:39,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gfv3gbn9sp5ipcfuqni3teocfid2bm7b0j6d8cnugcafqp3eo5pmdlp19h4j9g7b/family1/3c839992c9424573ba3a8f08f22fc123 into aab7fec0138e275e2b59795c7bfb8a31/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1f1f4999e68e4f4fa8702ab46eb55768_SeqId_47_ - updating store file list. 2023-02-13 12:01:39,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1f1f4999e68e4f4fa8702ab46eb55768_SeqId_47_ into aab7fec0138e275e2b59795c7bfb8a31/family1 2023-02-13 12:01:39,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gfv3gbn9sp5ipcfuqni3teocfid2bm7b0j6d8cnugcafqp3eo5pmdlp19h4j9g7b/family1/3c839992c9424573ba3a8f08f22fc123 into aab7fec0138e275e2b59795c7bfb8a31/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1f1f4999e68e4f4fa8702ab46eb55768_SeqId_47_) 2023-02-13 12:01:39,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gfv3gbn9sp5ipcfuqni3teocfid2bm7b0j6d8cnugcafqp3eo5pmdlp19h4j9g7b/family1/3c839992c9424573ba3a8f08f22fc123 2023-02-13 12:01:39,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 12:01:39,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 12:01:39,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): aab7fec0138e275e2b59795c7bfb8a31/family1 is initiating minor compaction (all files) 2023-02-13 12:01:39,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2f381e1b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:39,593 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of aab7fec0138e275e2b59795c7bfb8a31/family1 in testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:01:39,593 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f0654331113d4c2ca5fd32965f301a99, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/d57eb948f1c44912bc5a22bc6ab247ee, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1f1f4999e68e4f4fa8702ab46eb55768_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp, totalSize=178.1 K 2023-02-13 12:01:39,594 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting f0654331113d4c2ca5fd32965f301a99, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807319 2023-02-13 12:01:39,594 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting d57eb948f1c44912bc5a22bc6ab247ee, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207319 2023-02-13 12:01:39,595 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 1f1f4999e68e4f4fa8702ab46eb55768_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965207319 2023-02-13 12:01:39,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:01:39,596 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:39,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512015b7ce067737b461993f02ec382191047 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512015b7ce067737b461993f02ec382191047 2023-02-13 12:01:39,599 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120533796f3398434b80b8d95945403ba169 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120533796f3398434b80b8d95945403ba169 2023-02-13 12:01:39,601 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512282ce26686f8f440438b6d64ed2efb4f23 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512282ce26686f8f440438b6d64ed2efb4f23 2023-02-13 12:01:39,602 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231095e5e60868c42e591a5431bf64886f5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231095e5e60868c42e591a5431bf64886f5 2023-02-13 12:01:39,603 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 12:01:39,603 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 12:01:39,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:01:39,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:01:39,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/0e40f59d696c46a9a72ad6d5fb50d562, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1681c827672d46f591e285cd522cb490, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/8e7acc2f8bc24cebbf874c3d637ca8c2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/4465b8efe91349adbcf0459e14845119, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/824913080cfe4965925702e77c6850bf, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e3e8f5a1c4ec4061a832c4837d582871, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/c89e8ec8c5324ae5b915cce04b59d878, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f7dfd7f1132a4bcb9e257ae4d6c16ddc, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/305938de050f45218037e53c605e6eb8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e397dd97baf04da680c1fd67420d09fe_SeqId_44_] to archive 2023-02-13 12:01:39,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:39,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/0e40f59d696c46a9a72ad6d5fb50d562 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/0e40f59d696c46a9a72ad6d5fb50d562 2023-02-13 12:01:39,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1681c827672d46f591e285cd522cb490 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1681c827672d46f591e285cd522cb490 2023-02-13 12:01:39,631 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): aab7fec0138e275e2b59795c7bfb8a31#family1#compaction#23 average throughput is 6.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:01:39,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/8e7acc2f8bc24cebbf874c3d637ca8c2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/8e7acc2f8bc24cebbf874c3d637ca8c2 2023-02-13 12:01:39,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/4465b8efe91349adbcf0459e14845119 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/4465b8efe91349adbcf0459e14845119 2023-02-13 12:01:39,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/824913080cfe4965925702e77c6850bf to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/824913080cfe4965925702e77c6850bf 2023-02-13 12:01:39,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e3e8f5a1c4ec4061a832c4837d582871 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e3e8f5a1c4ec4061a832c4837d582871 2023-02-13 12:01:39,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/c89e8ec8c5324ae5b915cce04b59d878 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/c89e8ec8c5324ae5b915cce04b59d878 2023-02-13 12:01:39,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f7dfd7f1132a4bcb9e257ae4d6c16ddc to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f7dfd7f1132a4bcb9e257ae4d6c16ddc 2023-02-13 12:01:39,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/305938de050f45218037e53c605e6eb8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/305938de050f45218037e53c605e6eb8 2023-02-13 12:01:39,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e397dd97baf04da680c1fd67420d09fe_SeqId_44_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/e397dd97baf04da680c1fd67420d09fe_SeqId_44_ 2023-02-13 12:01:40,475 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130da0e0144b44d4c9b96c46445c999060f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130da0e0144b44d4c9b96c46445c999060f 2023-02-13 12:01:40,477 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:01:40,505 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7c92d599c35e41219fcb7f1efd76514b first=Optional[r00] last=Optional[r8] 2023-02-13 12:01:40,506 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7c92d599c35e41219fcb7f1efd76514b}] 2023-02-13 12:01:40,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7c92d599c35e41219fcb7f1efd76514b for inclusion in aab7fec0138e275e2b59795c7bfb8a31/family1 2023-02-13 12:01:40,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 12:01:40,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:01:40,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:40,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7c92d599c35e41219fcb7f1efd76514b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jids6uqqmb3dq9stasjmroqkpeu23kaegm1j7e3o48j553nsd1rin4b5njoam6ik/family1/7c92d599c35e41219fcb7f1efd76514b 2023-02-13 12:01:40,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jids6uqqmb3dq9stasjmroqkpeu23kaegm1j7e3o48j553nsd1rin4b5njoam6ik/family1/7c92d599c35e41219fcb7f1efd76514b as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/39b505f0413c4d3cbd27d394fa64ac8b_SeqId_49_ 2023-02-13 12:01:40,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jids6uqqmb3dq9stasjmroqkpeu23kaegm1j7e3o48j553nsd1rin4b5njoam6ik/family1/7c92d599c35e41219fcb7f1efd76514b into aab7fec0138e275e2b59795c7bfb8a31/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/39b505f0413c4d3cbd27d394fa64ac8b_SeqId_49_ - updating store file list. 2023-02-13 12:01:40,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/39b505f0413c4d3cbd27d394fa64ac8b_SeqId_49_ into aab7fec0138e275e2b59795c7bfb8a31/family1 2023-02-13 12:01:40,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jids6uqqmb3dq9stasjmroqkpeu23kaegm1j7e3o48j553nsd1rin4b5njoam6ik/family1/7c92d599c35e41219fcb7f1efd76514b into aab7fec0138e275e2b59795c7bfb8a31/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/39b505f0413c4d3cbd27d394fa64ac8b_SeqId_49_) 2023-02-13 12:01:40,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jids6uqqmb3dq9stasjmroqkpeu23kaegm1j7e3o48j553nsd1rin4b5njoam6ik/family1/7c92d599c35e41219fcb7f1efd76514b 2023-02-13 12:01:40,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:01:40,525 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:40,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201b6edf4c4de0440b80450359e9f2dcfc to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201b6edf4c4de0440b80450359e9f2dcfc 2023-02-13 12:01:40,528 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128328a8447b36c4900a61e4a4684f994bd to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128328a8447b36c4900a61e4a4684f994bd 2023-02-13 12:01:40,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511306ac97829843949219643fa5f6202a425 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511306ac97829843949219643fa5f6202a425 2023-02-13 12:01:40,529 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 12:01:40,529 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 12:01:40,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:01:40,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:01:40,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:01:40,530 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:01:40,530 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:01:40,531 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:01:40,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4580 sec 2023-02-13 12:01:40,635 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=248 (was 245) Potentially hanging thread: hconnection-0x6c475be6-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/cluster_b4fd01dc-bc14-be1f-77f3-175feca8744e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c475be6-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59126 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59226 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59242 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59032 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c475be6-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62284@0x62dd8dda sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/97546656.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:58980 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59064 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:58942 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59076 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62284@0x62dd8dda-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x6c475be6-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/cluster_b4fd01dc-bc14-be1f-77f3-175feca8744e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:58974 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c475be6-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c475be6-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-207202794_15 at /127.0.0.1:58910 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59056 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/94152604d26d4dcd92336ba4e03f8446 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59012 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-207202794_15 at /127.0.0.1:59120 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59110 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59096 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59092 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59042 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:58996 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62284@0x62dd8dda-SendThread(127.0.0.1:62284) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943484955_15 at /127.0.0.1:59160 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c475be6-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=603 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=233 (was 268), ProcessCount=165 (was 167), AvailableMemoryMB=6169 (was 4724) - AvailableMemoryMB LEAK? - 2023-02-13 12:01:40,647 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=248, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=233, ProcessCount=165, AvailableMemoryMB=6169 2023-02-13 12:01:40,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 12:01:40,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:40,652 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:01:40,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-13 12:01:40,653 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:01:40,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 12:01:40,654 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:01:40,655 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46 empty. 2023-02-13 12:01:40,655 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:01:40,655 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-13 12:01:40,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 12:01:40,862 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/.tmp/family1/94152604d26d4dcd92336ba4e03f8446 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/94152604d26d4dcd92336ba4e03f8446 2023-02-13 12:01:40,869 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in aab7fec0138e275e2b59795c7bfb8a31/family1 of aab7fec0138e275e2b59795c7bfb8a31 into 94152604d26d4dcd92336ba4e03f8446(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:01:40,869 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for aab7fec0138e275e2b59795c7bfb8a31: 2023-02-13 12:01:40,869 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676289699593; duration=1sec 2023-02-13 12:01:40,870 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:40,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f0654331113d4c2ca5fd32965f301a99, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/d57eb948f1c44912bc5a22bc6ab247ee, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1f1f4999e68e4f4fa8702ab46eb55768_SeqId_47_] to archive 2023-02-13 12:01:40,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:40,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f0654331113d4c2ca5fd32965f301a99 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/f0654331113d4c2ca5fd32965f301a99 2023-02-13 12:01:40,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/d57eb948f1c44912bc5a22bc6ab247ee to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/d57eb948f1c44912bc5a22bc6ab247ee 2023-02-13 12:01:40,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1f1f4999e68e4f4fa8702ab46eb55768_SeqId_47_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/family1/1f1f4999e68e4f4fa8702ab46eb55768_SeqId_47_ 2023-02-13 12:01:40,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 12:01:41,071 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 12:01:41,074 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 24b50ded31aa7904f2ee8370503f3b46, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:01:41,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 12:01:41,484 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:41,484 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 24b50ded31aa7904f2ee8370503f3b46, disabling compactions & flushes 2023-02-13 12:01:41,485 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:41,485 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:41,485 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. after waiting 0 ms 2023-02-13 12:01:41,485 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:41,485 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:41,485 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 24b50ded31aa7904f2ee8370503f3b46: Waiting for close lock at 1676289701484Disabling compacts and flushes for region at 1676289701484Disabling writes for close at 1676289701485 (+1 ms)Writing region close event to WAL at 1676289701485Closed at 1676289701485 2023-02-13 12:01:41,494 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:01:41,496 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676289701496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289701496"}]},"ts":"1676289701496"} 2023-02-13 12:01:41,498 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 12:01:41,500 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:01:41,500 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289701500"}]},"ts":"1676289701500"} 2023-02-13 12:01:41,502 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 12:01:41,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=24b50ded31aa7904f2ee8370503f3b46, ASSIGN}] 2023-02-13 12:01:41,619 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=24b50ded31aa7904f2ee8370503f3b46, ASSIGN 2023-02-13 12:01:41,621 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=24b50ded31aa7904f2ee8370503f3b46, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:01:41,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 12:01:41,773 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=24b50ded31aa7904f2ee8370503f3b46, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:41,773 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676289701772"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289701772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289701772"}]},"ts":"1676289701772"} 2023-02-13 12:01:41,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 24b50ded31aa7904f2ee8370503f3b46, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:41,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:41,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 24b50ded31aa7904f2ee8370503f3b46, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:01:41,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:01:41,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:41,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:01:41,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:01:41,941 INFO [StoreOpener-24b50ded31aa7904f2ee8370503f3b46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:01:41,943 DEBUG [StoreOpener-24b50ded31aa7904f2ee8370503f3b46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1 2023-02-13 12:01:41,943 DEBUG [StoreOpener-24b50ded31aa7904f2ee8370503f3b46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1 2023-02-13 12:01:41,943 INFO [StoreOpener-24b50ded31aa7904f2ee8370503f3b46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24b50ded31aa7904f2ee8370503f3b46 columnFamilyName family1 2023-02-13 12:01:41,945 INFO [StoreOpener-24b50ded31aa7904f2ee8370503f3b46-1] regionserver.HStore(310): Store=24b50ded31aa7904f2ee8370503f3b46/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:41,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:01:41,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:01:41,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:01:41,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:01:41,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 24b50ded31aa7904f2ee8370503f3b46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74046120, jitterRate=0.10337316989898682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:01:41,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 24b50ded31aa7904f2ee8370503f3b46: Running coprocessor pre-open hook at 1676289701940Writing region info on filesystem at 1676289701940Initializing all the Stores at 1676289701941 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676289701941Cleaning up temporary data from old regions at 1676289701948 (+7 ms)Cleaning up detritus from prior splits at 1676289701948Running coprocessor post-open hooks at 1676289701955 (+7 ms)Region opened successfully at 1676289701955 2023-02-13 12:01:41,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46., pid=25, masterSystemTime=1676289701929 2023-02-13 12:01:41,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:41,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:41,960 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=24b50ded31aa7904f2ee8370503f3b46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:41,960 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676289701960"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289701960"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289701960"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289701960"}]},"ts":"1676289701960"} 2023-02-13 12:01:41,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-13 12:01:41,965 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 24b50ded31aa7904f2ee8370503f3b46, server=jenkins-hbase16.apache.org,39857,1676289663697 in 186 msec 2023-02-13 12:01:41,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-13 12:01:41,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=24b50ded31aa7904f2ee8370503f3b46, ASSIGN in 349 msec 2023-02-13 12:01:41,967 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:01:41,967 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289701967"}]},"ts":"1676289701967"} 2023-02-13 12:01:41,968 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 12:01:41,999 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:01:42,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.3500 sec 2023-02-13 12:01:42,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 12:01:42,763 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-13 12:01:42,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:42,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:42,800 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:42,800 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:42,800 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:42,800 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:42,800 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:42,800 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:42,831 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:42,831 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:42,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:42,832 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:42,832 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:42,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:42,833 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:42,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:42,833 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:42,833 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:42,833 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:42,834 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:42,834 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:42,834 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:42,834 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:42,834 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 12:01:43,258 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113042463c3dae3b4f66a811013a1b0d96a6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113042463c3dae3b4f66a811013a1b0d96a6 2023-02-13 12:01:43,264 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/2183acc439c74257991c26ae063b6792 2023-02-13 12:01:43,271 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/2183acc439c74257991c26ae063b6792 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/2183acc439c74257991c26ae063b6792 2023-02-13 12:01:43,276 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/2183acc439c74257991c26ae063b6792, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 12:01:43,277 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 443ms, sequenceid=5, compaction requested=false 2023-02-13 12:01:43,278 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:43,278 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:43,278 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:43,278 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:43,278 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:43,278 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,278 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:43,278 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:43,306 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,306 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:43,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:43,307 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:43,307 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:43,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:43,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@307fa493[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:43,310 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:43,310 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,321 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,321 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:43,321 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:43,321 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:43,321 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,321 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:43,331 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:43,331 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,331 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:43,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:43,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:43,332 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:43,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:43,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:43,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:43,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:43,341 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:43,341 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:43,341 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:43,341 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,342 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:43,354 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,354 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,354 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:43,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:43,355 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,356 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,364 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:43,364 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,364 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,364 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:43,365 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:43,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:43,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:43,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:43,365 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:43,365 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:43,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:43,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:43,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:43,466 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:43,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:43,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:43,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:43,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,481 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:43,482 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:43,482 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:43,482 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:43,482 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,482 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,489 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:43,490 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:43,490 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,490 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:43,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:43,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,492 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,492 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:01:43,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:43,492 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:43,492 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:43,492 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:43,492 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:43,492 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:43,493 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:43,493 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:43,493 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 12:01:43,919 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cbcdf46d864b46d7a82478c15e0ba238 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128cbcdf46d864b46d7a82478c15e0ba238 2023-02-13 12:01:44,327 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/aec245cf3ce74a63a2f9682f177fed5f 2023-02-13 12:01:44,340 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/aec245cf3ce74a63a2f9682f177fed5f as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/aec245cf3ce74a63a2f9682f177fed5f 2023-02-13 12:01:44,348 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/aec245cf3ce74a63a2f9682f177fed5f, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 12:01:44,349 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 856ms, sequenceid=9, compaction requested=false 2023-02-13 12:01:44,350 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:44,350 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:44,350 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:44,350 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:44,350 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,350 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:44,350 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:44,381 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,381 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:44,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:44,382 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,382 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:44,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:44,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:44,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78b74213[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:44,386 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:44,386 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,395 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,396 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:44,396 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:44,396 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:44,396 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,396 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:44,406 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:44,407 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:44,407 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:44,406 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:44,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:44,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:44,418 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:44,418 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:44,418 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:44,418 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,418 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:44,429 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,429 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:44,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:44,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,429 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:44,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:44,430 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,433 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:44,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,445 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:44,445 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:44,445 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,445 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:44,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:44,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:44,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:44,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:44,445 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,446 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,446 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:44,446 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,446 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:44,446 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,446 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:44,446 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,546 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:44,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:44,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:44,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:44,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,559 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:44,559 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:44,559 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:44,559 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:44,560 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,560 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,570 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,570 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:44,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:44,571 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:44,571 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:44,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,573 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,574 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:01:44,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:44,574 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:44,574 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:44,574 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:44,574 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:44,575 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:44,575 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:44,575 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:44,575 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:45,002 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b33078261b87468ca41988662d000747 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201b33078261b87468ca41988662d000747 2023-02-13 12:01:45,411 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/e68f6ab4d7bd48deb4e7adb234cf6e20 2023-02-13 12:01:45,424 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/e68f6ab4d7bd48deb4e7adb234cf6e20 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/e68f6ab4d7bd48deb4e7adb234cf6e20 2023-02-13 12:01:45,433 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/e68f6ab4d7bd48deb4e7adb234cf6e20, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 12:01:45,434 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 859ms, sequenceid=13, compaction requested=true 2023-02-13 12:01:45,434 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:45,434 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:45,435 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:45,435 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:45,435 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,435 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:45,435 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:45,465 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,465 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:45,466 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,466 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:45,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:45,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bd9fd99[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:45,472 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:45,472 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,481 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:45,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:45,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:45,482 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,482 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:45,490 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,490 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:45,490 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:45,490 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:45,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:45,500 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:45,500 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:45,500 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:45,500 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,501 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:45,535 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,535 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:45,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,535 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:45,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:45,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:45,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:45,537 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:45,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:45,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,540 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:45,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,556 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,556 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:45,556 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:45,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:45,556 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:45,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:45,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:45,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:45,556 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:45,557 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,557 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:45,557 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:45,558 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:45,557 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:45,558 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,558 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,658 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:45,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:45,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:45,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:45,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,672 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:45,672 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:45,672 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:45,672 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:45,673 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,673 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,681 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:45,681 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:45,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:45,682 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:45,682 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:45,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:45,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,683 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,683 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:01:45,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:45,683 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:45,683 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:45,683 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:45,683 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:45,683 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:45,683 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:45,683 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:45,683 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:46,106 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053cf96b8c1f464c6db92da33872061595 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512053cf96b8c1f464c6db92da33872061595 2023-02-13 12:01:46,516 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/6db0c6b7295142d9837eaa98dda605a0 2023-02-13 12:01:46,529 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/6db0c6b7295142d9837eaa98dda605a0 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/6db0c6b7295142d9837eaa98dda605a0 2023-02-13 12:01:46,535 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/6db0c6b7295142d9837eaa98dda605a0, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 12:01:46,536 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 853ms, sequenceid=17, compaction requested=true 2023-02-13 12:01:46,536 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:46,536 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:46,536 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:46,537 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:46,537 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,537 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:46,537 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:46,548 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,548 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:46,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:46,548 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,548 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:46,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:46,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:46,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:46,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:46,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@149a1e9d[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:46,552 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:46,552 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,562 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,562 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:46,563 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:46,563 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:46,563 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,563 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:46,573 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:46,573 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:46,573 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:46,573 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:46,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:46,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:46,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:46,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:46,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:46,583 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:46,583 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:46,583 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:46,583 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,583 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:46,589 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,589 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:46,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,590 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:46,590 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,592 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:46,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,603 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:46,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:46,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:46,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:46,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:46,604 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:46,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:46,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:46,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:46,605 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:46,605 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,605 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:46,605 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,605 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,605 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,705 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:46,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:46,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:46,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:46,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,716 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:46,716 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:46,717 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:46,717 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:46,717 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,718 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,723 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:46,723 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:46,723 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:46,724 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:46,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:46,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,725 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,726 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:01:46,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:46,726 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:46,726 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:46,726 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:46,726 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:46,726 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:46,727 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:46,727 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:46,727 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:47,149 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284c615e6ea05d4b749df952641f614a83 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512284c615e6ea05d4b749df952641f614a83 2023-02-13 12:01:47,473 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:01:47,557 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/1eda637d8d8c4977992a1678d7892cdd 2023-02-13 12:01:47,566 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/1eda637d8d8c4977992a1678d7892cdd as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1eda637d8d8c4977992a1678d7892cdd 2023-02-13 12:01:47,574 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1eda637d8d8c4977992a1678d7892cdd, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 12:01:47,576 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 849ms, sequenceid=21, compaction requested=true 2023-02-13 12:01:47,576 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:47,576 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:47,576 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:47,576 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:47,576 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,576 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:47,576 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:47,606 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,606 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:47,607 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,607 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:47,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:47,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@590c6ba1[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:47,611 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:47,611 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,623 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,623 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:47,623 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:47,623 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:47,624 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,624 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:47,631 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:47,631 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,631 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:47,632 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:47,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:47,642 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:47,642 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:47,642 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:47,642 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,642 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:47,654 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,654 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:47,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,654 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:47,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:47,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:47,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:47,655 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:47,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:47,659 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:47,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,673 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:47,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:47,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:47,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:47,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:47,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:47,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:47,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:47,673 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,673 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:47,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:47,674 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:47,674 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:47,774 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:47,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:47,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:47,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:47,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,790 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:47,791 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:47,791 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:47,791 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:47,791 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,792 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,798 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:47,798 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:47,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:47,799 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:47,799 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:47,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:47,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,800 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,801 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:01:47,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:47,801 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:47,801 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:47,801 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:47,802 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:47,802 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:47,802 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:47,802 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:47,802 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:48,232 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231770883c2db944a3eb5cbf22e3716d042 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231770883c2db944a3eb5cbf22e3716d042 2023-02-13 12:01:48,641 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/f58619e00a39420eb1f5db4db70b4ff2 2023-02-13 12:01:48,654 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/f58619e00a39420eb1f5db4db70b4ff2 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/f58619e00a39420eb1f5db4db70b4ff2 2023-02-13 12:01:48,661 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/f58619e00a39420eb1f5db4db70b4ff2, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 12:01:48,662 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 860ms, sequenceid=25, compaction requested=true 2023-02-13 12:01:48,663 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:48,663 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:48,663 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:48,663 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:48,663 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,663 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:48,663 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:48,697 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,697 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:48,698 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,698 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:48,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:48,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1be91d49[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:48,700 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:48,700 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,706 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,706 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:48,706 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:48,706 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:48,706 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,706 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:48,733 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:48,733 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,733 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:48,733 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:48,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:48,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:48,736 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:48,736 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:48,736 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:48,736 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,736 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:48,747 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,747 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:48,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,748 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:48,748 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,749 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:48,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:48,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:48,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:48,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:48,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,756 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:48,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:48,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:48,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,756 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:48,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:48,757 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,757 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:48,857 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:48,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:48,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:48,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:48,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,862 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:48,862 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:48,862 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:48,863 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:48,863 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,863 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,872 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:48,873 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:48,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:48,873 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:48,873 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:48,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:48,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,874 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,874 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:01:48,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:48,874 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:48,874 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:48,874 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:48,875 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:48,875 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:48,875 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:48,875 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:48,875 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:49,291 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101bd322e15e9be428d89aff304cc2ad54a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101bd322e15e9be428d89aff304cc2ad54a 2023-02-13 12:01:49,701 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/38678aa1bb9642d3957a733c043e357a 2023-02-13 12:01:49,713 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/38678aa1bb9642d3957a733c043e357a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/38678aa1bb9642d3957a733c043e357a 2023-02-13 12:01:49,720 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/38678aa1bb9642d3957a733c043e357a, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 12:01:49,721 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 846ms, sequenceid=29, compaction requested=true 2023-02-13 12:01:49,721 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:49,721 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:49,721 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:49,721 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:49,721 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,722 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:49,722 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:49,756 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,756 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:49,756 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,757 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:49,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:49,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f181e98[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:49,758 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:49,758 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,764 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,764 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:49,764 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:49,764 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:49,765 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,765 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:49,772 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,772 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:49,773 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:49,773 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:49,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:49,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:49,776 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:49,776 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:49,776 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:49,776 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,776 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:49,787 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,787 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:49,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,787 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:49,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:49,788 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:49,790 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:49,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,798 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,798 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:49,798 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,798 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:49,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:49,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:49,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:49,798 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:49,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:49,799 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:49,799 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:49,798 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,798 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:49,799 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:49,799 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:49,800 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,899 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:49,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:49,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:49,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:49,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,916 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:49,916 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:49,916 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:49,916 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:49,917 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,917 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,922 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:49,923 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:49,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:49,923 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:49,923 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:49,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,924 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:49,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,924 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,924 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:01:49,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:49,924 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:49,924 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:49,924 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:49,925 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:49,925 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:49,925 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:49,925 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:49,925 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:50,351 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010363e686665b694ad3896bc0eca7a3cc61 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010363e686665b694ad3896bc0eca7a3cc61 2023-02-13 12:01:50,758 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/565e0b7d74964b72ae19910ce6dd3043 2023-02-13 12:01:50,770 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/565e0b7d74964b72ae19910ce6dd3043 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/565e0b7d74964b72ae19910ce6dd3043 2023-02-13 12:01:50,777 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/565e0b7d74964b72ae19910ce6dd3043, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 12:01:50,778 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 853ms, sequenceid=33, compaction requested=true 2023-02-13 12:01:50,778 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:50,778 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:50,778 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:50,778 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:50,778 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,778 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:50,778 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:50,806 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,806 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:50,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:50,807 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,807 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:50,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:50,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b329d10[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:50,811 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:50,811 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,820 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,821 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:50,821 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:50,821 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:50,821 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,821 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:50,831 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:50,831 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:50,831 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,831 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:50,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:50,841 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:50,841 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:50,841 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:50,841 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,841 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:50,853 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,853 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,854 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:50,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:50,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:50,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:50,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:50,855 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:50,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:50,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,858 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,870 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,870 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:50,870 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:50,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:50,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:50,870 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:50,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:50,870 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:50,870 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:50,871 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:50,871 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:50,871 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:50,871 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:50,872 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,872 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,972 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:50,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:50,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:50,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:50,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,987 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:50,987 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:50,987 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:50,987 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:50,987 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,987 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,997 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,997 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:50,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:50,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:50,998 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:50,998 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:50,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:50,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:51,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,001 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,001 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:01:51,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,001 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:51,001 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:51,002 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:51,002 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:51,002 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:51,002 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:51,002 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:51,002 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:51,424 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b172d3034eb2476ea70cb0afe74ae154 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907b172d3034eb2476ea70cb0afe74ae154 2023-02-13 12:01:51,833 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/0690333ffd9f4f6db458e76b5d3efb44 2023-02-13 12:01:51,847 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/0690333ffd9f4f6db458e76b5d3efb44 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/0690333ffd9f4f6db458e76b5d3efb44 2023-02-13 12:01:51,852 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/0690333ffd9f4f6db458e76b5d3efb44, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 12:01:51,853 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 851ms, sequenceid=37, compaction requested=true 2023-02-13 12:01:51,853 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:51,853 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:51,853 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:51,854 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:51,854 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,854 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:51,854 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:51,902 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,902 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:51,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:51,903 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,903 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:51,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:51,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:51,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:51,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:51,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2159bcb4[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:51,907 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:51,907 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,923 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,923 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:51,923 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:51,923 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:51,923 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,924 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:51,931 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:51,931 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:51,931 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,931 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:51,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:51,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:51,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:51,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:51,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:51,937 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:51,937 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:51,937 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:51,937 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,937 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:51,947 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,947 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,947 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:51,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:51,948 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,949 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:51,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:51,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:51,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:51,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:51,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:51,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:51,956 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:51,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:51,956 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,956 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:51,957 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:51,957 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:52,057 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:52,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:52,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:52,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:52,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,072 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:52,072 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:52,072 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:01:52,072 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:01:52,073 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,073 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,081 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,081 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:52,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:52,082 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,082 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:52,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,085 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,085 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:01:52,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,085 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:01:52,086 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:52,086 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:01:52,086 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:01:52,086 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:52,086 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:52,086 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. started... 2023-02-13 12:01:52,087 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24b50ded31aa7904f2ee8370503f3b46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:01:52,514 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120704b8fc80a6d45acbe632c9de490025d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120704b8fc80a6d45acbe632c9de490025d 2023-02-13 12:01:52,923 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/1406b1f5ba03474ab6a64c467e328783 2023-02-13 12:01:52,936 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/1406b1f5ba03474ab6a64c467e328783 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1406b1f5ba03474ab6a64c467e328783 2023-02-13 12:01:52,942 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1406b1f5ba03474ab6a64c467e328783, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 12:01:52,943 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 24b50ded31aa7904f2ee8370503f3b46 in 856ms, sequenceid=41, compaction requested=true 2023-02-13 12:01:52,943 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:52,943 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:52,943 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:01:52,944 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:01:52,944 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,944 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:01:52,944 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:01:52,972 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,972 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:52,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:52,973 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,973 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:52,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:52,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:52,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:52,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:01:52,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7209fe83[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:52,975 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:01:52,975 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,981 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,981 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:01:52,981 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:01:52,981 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:52,981 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,981 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:52,989 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:01:52,989 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:52,989 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:01:52,989 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:52,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:52,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:52,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:52,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:52,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:01:52,993 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:01:52,993 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:52,993 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:52,993 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:52,993 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:53,003 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,003 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,003 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:53,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:53,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:53,005 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:53,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:53,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:53,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,007 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:53,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:53,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:53,020 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:53,020 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:53,020 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:53,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:53,020 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:53,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 12:01:53,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:53,021 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:53,020 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:01:53,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:53,022 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:53,022 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:53,021 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:53,022 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,022 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,022 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,122 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:53,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:53,129 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-13 12:01:53,133 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:01:53,134 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:01:53,136 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:01:53,136 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290313136 2023-02-13 12:01:53,139 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 12:01:53,140 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 12:01:53,141 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:01:53,141 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x5b0f2f39 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:01:53,156 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dc1d7d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:01:53,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,010 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fe22199e954c49d7a45053005ce37f10 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fe22199e954c49d7a45053005ce37f10 2023-02-13 12:01:54,011 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:01:54,024 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:01:54,025 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34038, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:01:54,032 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:01:54,034 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:52134, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:01:54,043 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9a9d67cef7364c3587ad1e0b5b3b16c5 first=Optional[r3] last=Optional[r6] 2023-02-13 12:01:54,044 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9a9d67cef7364c3587ad1e0b5b3b16c5}] 2023-02-13 12:01:54,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9a9d67cef7364c3587ad1e0b5b3b16c5 for inclusion in 24b50ded31aa7904f2ee8370503f3b46/family1 2023-02-13 12:01:54,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 12:01:54,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:01:54,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:54,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9a9d67cef7364c3587ad1e0b5b3b16c5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fjmu7upaejkd2gocsl0ktt0vdvhspin8c31ocl4qmnlpg9e4j673mqld4ol8qi3m/family1/9a9d67cef7364c3587ad1e0b5b3b16c5 2023-02-13 12:01:54,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fjmu7upaejkd2gocsl0ktt0vdvhspin8c31ocl4qmnlpg9e4j673mqld4ol8qi3m/family1/9a9d67cef7364c3587ad1e0b5b3b16c5 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/7ee06ce82be04b8ba707f29d49afcbe9_SeqId_44_ 2023-02-13 12:01:54,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fjmu7upaejkd2gocsl0ktt0vdvhspin8c31ocl4qmnlpg9e4j673mqld4ol8qi3m/family1/9a9d67cef7364c3587ad1e0b5b3b16c5 into 24b50ded31aa7904f2ee8370503f3b46/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/7ee06ce82be04b8ba707f29d49afcbe9_SeqId_44_ - updating store file list. 2023-02-13 12:01:54,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/7ee06ce82be04b8ba707f29d49afcbe9_SeqId_44_ into 24b50ded31aa7904f2ee8370503f3b46/family1 2023-02-13 12:01:54,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fjmu7upaejkd2gocsl0ktt0vdvhspin8c31ocl4qmnlpg9e4j673mqld4ol8qi3m/family1/9a9d67cef7364c3587ad1e0b5b3b16c5 into 24b50ded31aa7904f2ee8370503f3b46/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/7ee06ce82be04b8ba707f29d49afcbe9_SeqId_44_) 2023-02-13 12:01:54,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fjmu7upaejkd2gocsl0ktt0vdvhspin8c31ocl4qmnlpg9e4j673mqld4ol8qi3m/family1/9a9d67cef7364c3587ad1e0b5b3b16c5 2023-02-13 12:01:54,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 12:01:54,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 12:01:54,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 24b50ded31aa7904f2ee8370503f3b46/family1 is initiating minor compaction 2023-02-13 12:01:54,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7ac258c7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:54,066 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 24b50ded31aa7904f2ee8370503f3b46/family1 in testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:54,066 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/aec245cf3ce74a63a2f9682f177fed5f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/e68f6ab4d7bd48deb4e7adb234cf6e20, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/6db0c6b7295142d9837eaa98dda605a0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1eda637d8d8c4977992a1678d7892cdd, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/f58619e00a39420eb1f5db4db70b4ff2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/38678aa1bb9642d3957a733c043e357a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/565e0b7d74964b72ae19910ce6dd3043, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/0690333ffd9f4f6db458e76b5d3efb44, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1406b1f5ba03474ab6a64c467e328783, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/7ee06ce82be04b8ba707f29d49afcbe9_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp, totalSize=50.0 K 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting aec245cf3ce74a63a2f9682f177fed5f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting e68f6ab4d7bd48deb4e7adb234cf6e20, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 6db0c6b7295142d9837eaa98dda605a0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 1eda637d8d8c4977992a1678d7892cdd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting f58619e00a39420eb1f5db4db70b4ff2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 38678aa1bb9642d3957a733c043e357a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 565e0b7d74964b72ae19910ce6dd3043, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 0690333ffd9f4f6db458e76b5d3efb44, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 1406b1f5ba03474ab6a64c467e328783, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 12:01:54,067 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 7ee06ce82be04b8ba707f29d49afcbe9_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 12:01:54,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:01:54,070 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:54,071 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512284c615e6ea05d4b749df952641f614a83 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512284c615e6ea05d4b749df952641f614a83 2023-02-13 12:01:54,073 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231770883c2db944a3eb5cbf22e3716d042 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231770883c2db944a3eb5cbf22e3716d042 2023-02-13 12:01:54,075 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101bd322e15e9be428d89aff304cc2ad54a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101bd322e15e9be428d89aff304cc2ad54a 2023-02-13 12:01:54,076 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010363e686665b694ad3896bc0eca7a3cc61 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010363e686665b694ad3896bc0eca7a3cc61 2023-02-13 12:01:54,077 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 12:01:54,077 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 12:01:54,077 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,077 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,077 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,099 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] throttle.PressureAwareThroughputController(145): 24b50ded31aa7904f2ee8370503f3b46#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:01:54,928 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cbc5378809fa44a0a2431aac6e6098c3 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205cbc5378809fa44a0a2431aac6e6098c3 2023-02-13 12:01:54,929 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/b0ef00ec1fc04a578b240c7a1c8501d8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/b0ef00ec1fc04a578b240c7a1c8501d8 2023-02-13 12:01:54,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:01:54,935 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 24b50ded31aa7904f2ee8370503f3b46/family1 of 24b50ded31aa7904f2ee8370503f3b46 into b0ef00ec1fc04a578b240c7a1c8501d8(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:01:54,935 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:54,935 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676289714066; duration=0sec 2023-02-13 12:01:54,935 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:54,954 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d2b6f010d074c029dee7a23ecbe3b94 first=Optional[r1] last=Optional[r2] 2023-02-13 12:01:54,955 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d2b6f010d074c029dee7a23ecbe3b94}] 2023-02-13 12:01:54,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d2b6f010d074c029dee7a23ecbe3b94 for inclusion in 24b50ded31aa7904f2ee8370503f3b46/family1 2023-02-13 12:01:54,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 12:01:54,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:01:54,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:54,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d2b6f010d074c029dee7a23ecbe3b94 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2m6emabr71bpimie1ap6mrltbhmb61025rrl4olsn7nk05u0igs7b3m7rso2s2iv/family1/6d2b6f010d074c029dee7a23ecbe3b94 2023-02-13 12:01:54,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2m6emabr71bpimie1ap6mrltbhmb61025rrl4olsn7nk05u0igs7b3m7rso2s2iv/family1/6d2b6f010d074c029dee7a23ecbe3b94 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/32a6d688493e41d79297b2f60c68a810_SeqId_47_ 2023-02-13 12:01:54,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2m6emabr71bpimie1ap6mrltbhmb61025rrl4olsn7nk05u0igs7b3m7rso2s2iv/family1/6d2b6f010d074c029dee7a23ecbe3b94 into 24b50ded31aa7904f2ee8370503f3b46/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/32a6d688493e41d79297b2f60c68a810_SeqId_47_ - updating store file list. 2023-02-13 12:01:54,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/32a6d688493e41d79297b2f60c68a810_SeqId_47_ into 24b50ded31aa7904f2ee8370503f3b46/family1 2023-02-13 12:01:54,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2m6emabr71bpimie1ap6mrltbhmb61025rrl4olsn7nk05u0igs7b3m7rso2s2iv/family1/6d2b6f010d074c029dee7a23ecbe3b94 into 24b50ded31aa7904f2ee8370503f3b46/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/32a6d688493e41d79297b2f60c68a810_SeqId_47_) 2023-02-13 12:01:54,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2m6emabr71bpimie1ap6mrltbhmb61025rrl4olsn7nk05u0igs7b3m7rso2s2iv/family1/6d2b6f010d074c029dee7a23ecbe3b94 2023-02-13 12:01:54,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 12:01:54,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 12:01:54,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 24b50ded31aa7904f2ee8370503f3b46/family1 is initiating minor compaction (all files) 2023-02-13 12:01:54,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@54d63be7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:54,974 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 24b50ded31aa7904f2ee8370503f3b46/family1 in testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:01:54,974 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/2183acc439c74257991c26ae063b6792, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/b0ef00ec1fc04a578b240c7a1c8501d8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/32a6d688493e41d79297b2f60c68a810_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp, totalSize=176.8 K 2023-02-13 12:01:54,975 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 2183acc439c74257991c26ae063b6792, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807319 2023-02-13 12:01:54,975 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting b0ef00ec1fc04a578b240c7a1c8501d8, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207319 2023-02-13 12:01:54,976 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 32a6d688493e41d79297b2f60c68a810_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965207319 2023-02-13 12:01:54,976 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:01:54,977 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:54,978 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201b33078261b87468ca41988662d000747 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201b33078261b87468ca41988662d000747 2023-02-13 12:01:54,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512053cf96b8c1f464c6db92da33872061595 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512053cf96b8c1f464c6db92da33872061595 2023-02-13 12:01:54,979 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-13 12:01:54,979 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 12:01:54,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:01:54,980 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:01:54,980 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:01:54,981 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:01:54,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8500 sec 2023-02-13 12:01:54,993 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): 24b50ded31aa7904f2ee8370503f3b46#family1#compaction#35 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:01:55,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/aec245cf3ce74a63a2f9682f177fed5f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/e68f6ab4d7bd48deb4e7adb234cf6e20, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/6db0c6b7295142d9837eaa98dda605a0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1eda637d8d8c4977992a1678d7892cdd, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/f58619e00a39420eb1f5db4db70b4ff2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/38678aa1bb9642d3957a733c043e357a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/565e0b7d74964b72ae19910ce6dd3043, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/0690333ffd9f4f6db458e76b5d3efb44, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1406b1f5ba03474ab6a64c467e328783, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/7ee06ce82be04b8ba707f29d49afcbe9_SeqId_44_] to archive 2023-02-13 12:01:55,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:55,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/aec245cf3ce74a63a2f9682f177fed5f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/aec245cf3ce74a63a2f9682f177fed5f 2023-02-13 12:01:55,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/e68f6ab4d7bd48deb4e7adb234cf6e20 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/e68f6ab4d7bd48deb4e7adb234cf6e20 2023-02-13 12:01:55,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/6db0c6b7295142d9837eaa98dda605a0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/6db0c6b7295142d9837eaa98dda605a0 2023-02-13 12:01:55,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1eda637d8d8c4977992a1678d7892cdd to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1eda637d8d8c4977992a1678d7892cdd 2023-02-13 12:01:55,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/f58619e00a39420eb1f5db4db70b4ff2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/f58619e00a39420eb1f5db4db70b4ff2 2023-02-13 12:01:55,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/38678aa1bb9642d3957a733c043e357a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/38678aa1bb9642d3957a733c043e357a 2023-02-13 12:01:55,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/565e0b7d74964b72ae19910ce6dd3043 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/565e0b7d74964b72ae19910ce6dd3043 2023-02-13 12:01:55,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/0690333ffd9f4f6db458e76b5d3efb44 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/0690333ffd9f4f6db458e76b5d3efb44 2023-02-13 12:01:55,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1406b1f5ba03474ab6a64c467e328783 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/1406b1f5ba03474ab6a64c467e328783 2023-02-13 12:01:55,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/7ee06ce82be04b8ba707f29d49afcbe9_SeqId_44_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/7ee06ce82be04b8ba707f29d49afcbe9_SeqId_44_ 2023-02-13 12:01:55,071 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=253 (was 248) - Thread LEAK? -, OpenFileDescriptor=603 (was 603), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 233), ProcessCount=165 (was 165), AvailableMemoryMB=6163 (was 6169) 2023-02-13 12:01:55,084 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=251, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=181, ProcessCount=165, AvailableMemoryMB=6162 2023-02-13 12:01:55,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 12:01:55,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:55,089 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:01:55,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-13 12:01:55,090 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:01:55,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 12:01:55,092 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:55,092 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:55,092 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:55,093 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6 empty. 2023-02-13 12:01:55,093 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88 empty. 2023-02-13 12:01:55,093 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0 empty. 2023-02-13 12:01:55,093 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:55,093 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:55,093 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:55,093 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-13 12:01:55,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 12:01:55,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 12:01:55,507 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-13 12:01:55,509 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => 28693c501211634a844bcf56f3d30bb6, NAME => 'testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:01:55,510 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => ccad418e6257284c5dd66c3dc38417e0, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:01:55,510 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => c5b275f1912d0846361b5d2dd52a2f88, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:01:55,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 12:01:55,925 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:55,925 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:55,925 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing ccad418e6257284c5dd66c3dc38417e0, disabling compactions & flushes 2023-02-13 12:01:55,925 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:55,925 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing c5b275f1912d0846361b5d2dd52a2f88, disabling compactions & flushes 2023-02-13 12:01:55,925 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:55,925 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:55,925 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:55,925 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. after waiting 0 ms 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. after waiting 0 ms 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:55,926 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing 28693c501211634a844bcf56f3d30bb6, disabling compactions & flushes 2023-02-13 12:01:55,926 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for c5b275f1912d0846361b5d2dd52a2f88: Waiting for close lock at 1676289715925Disabling compacts and flushes for region at 1676289715925Disabling writes for close at 1676289715926 (+1 ms)Writing region close event to WAL at 1676289715926Closed at 1676289715926 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for ccad418e6257284c5dd66c3dc38417e0: Waiting for close lock at 1676289715925Disabling compacts and flushes for region at 1676289715925Disabling writes for close at 1676289715926 (+1 ms)Writing region close event to WAL at 1676289715926Closed at 1676289715926 2023-02-13 12:01:55,926 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. after waiting 0 ms 2023-02-13 12:01:55,926 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:55,927 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:55,927 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for 28693c501211634a844bcf56f3d30bb6: Waiting for close lock at 1676289715926Disabling compacts and flushes for region at 1676289715926Disabling writes for close at 1676289715926Writing region close event to WAL at 1676289715927 (+1 ms)Closed at 1676289715927 2023-02-13 12:01:55,930 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:01:55,932 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676289715931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289715931"}]},"ts":"1676289715931"} 2023-02-13 12:01:55,932 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676289715931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289715931"}]},"ts":"1676289715931"} 2023-02-13 12:01:55,932 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676289715931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289715931"}]},"ts":"1676289715931"} 2023-02-13 12:01:55,936 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 12:01:55,937 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:01:55,937 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289715937"}]},"ts":"1676289715937"} 2023-02-13 12:01:55,939 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-13 12:01:55,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=28693c501211634a844bcf56f3d30bb6, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c5b275f1912d0846361b5d2dd52a2f88, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ccad418e6257284c5dd66c3dc38417e0, ASSIGN}] 2023-02-13 12:01:55,994 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ccad418e6257284c5dd66c3dc38417e0, ASSIGN 2023-02-13 12:01:55,995 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c5b275f1912d0846361b5d2dd52a2f88, ASSIGN 2023-02-13 12:01:55,995 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=28693c501211634a844bcf56f3d30bb6, ASSIGN 2023-02-13 12:01:55,997 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ccad418e6257284c5dd66c3dc38417e0, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:01:55,997 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c5b275f1912d0846361b5d2dd52a2f88, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:01:55,997 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=28693c501211634a844bcf56f3d30bb6, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:01:56,151 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=28693c501211634a844bcf56f3d30bb6, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:56,151 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=ccad418e6257284c5dd66c3dc38417e0, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:56,151 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c5b275f1912d0846361b5d2dd52a2f88, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:56,151 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676289716151"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289716151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289716151"}]},"ts":"1676289716151"} 2023-02-13 12:01:56,152 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676289716151"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289716151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289716151"}]},"ts":"1676289716151"} 2023-02-13 12:01:56,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676289716151"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289716151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289716151"}]},"ts":"1676289716151"} 2023-02-13 12:01:56,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 28693c501211634a844bcf56f3d30bb6, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:56,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure ccad418e6257284c5dd66c3dc38417e0, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:56,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure c5b275f1912d0846361b5d2dd52a2f88, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:01:56,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 12:01:56,228 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/.tmp/family1/cd60c2a81d1d4c2d831a3f4a64f30fdf as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/cd60c2a81d1d4c2d831a3f4a64f30fdf 2023-02-13 12:01:56,238 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 24b50ded31aa7904f2ee8370503f3b46/family1 of 24b50ded31aa7904f2ee8370503f3b46 into cd60c2a81d1d4c2d831a3f4a64f30fdf(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:01:56,238 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 24b50ded31aa7904f2ee8370503f3b46: 2023-02-13 12:01:56,239 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676289714974; duration=1sec 2023-02-13 12:01:56,239 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:01:56,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/2183acc439c74257991c26ae063b6792, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/b0ef00ec1fc04a578b240c7a1c8501d8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/32a6d688493e41d79297b2f60c68a810_SeqId_47_] to archive 2023-02-13 12:01:56,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:01:56,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:56,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ccad418e6257284c5dd66c3dc38417e0, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 12:01:56,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:56,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:56,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/2183acc439c74257991c26ae063b6792 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/2183acc439c74257991c26ae063b6792 2023-02-13 12:01:56,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:56,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:56,320 INFO [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:56,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/b0ef00ec1fc04a578b240c7a1c8501d8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/b0ef00ec1fc04a578b240c7a1c8501d8 2023-02-13 12:01:56,322 DEBUG [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1 2023-02-13 12:01:56,322 DEBUG [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1 2023-02-13 12:01:56,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/32a6d688493e41d79297b2f60c68a810_SeqId_47_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/family1/32a6d688493e41d79297b2f60c68a810_SeqId_47_ 2023-02-13 12:01:56,322 INFO [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccad418e6257284c5dd66c3dc38417e0 columnFamilyName family1 2023-02-13 12:01:56,324 INFO [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] regionserver.HStore(310): Store=ccad418e6257284c5dd66c3dc38417e0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:56,324 INFO [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:56,326 DEBUG [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family2 2023-02-13 12:01:56,326 DEBUG [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family2 2023-02-13 12:01:56,327 INFO [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccad418e6257284c5dd66c3dc38417e0 columnFamilyName family2 2023-02-13 12:01:56,328 INFO [StoreOpener-ccad418e6257284c5dd66c3dc38417e0-1] regionserver.HStore(310): Store=ccad418e6257284c5dd66c3dc38417e0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:56,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:56,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:56,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:01:56,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:01:56,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:01:56,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened ccad418e6257284c5dd66c3dc38417e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59605762, jitterRate=-0.11180493235588074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:01:56,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for ccad418e6257284c5dd66c3dc38417e0: Running coprocessor pre-open hook at 1676289716318Writing region info on filesystem at 1676289716318Initializing all the Stores at 1676289716320 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289716320Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289716320Cleaning up temporary data from old regions at 1676289716331 (+11 ms)Cleaning up detritus from prior splits at 1676289716331Running coprocessor post-open hooks at 1676289716338 (+7 ms)Region opened successfully at 1676289716338 2023-02-13 12:01:56,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0., pid=32, masterSystemTime=1676289716308 2023-02-13 12:01:56,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:56,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:56,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:56,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5b275f1912d0846361b5d2dd52a2f88, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 12:01:56,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:56,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:56,342 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=ccad418e6257284c5dd66c3dc38417e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:56,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:56,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:56,342 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676289716342"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289716342"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289716342"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289716342"}]},"ts":"1676289716342"} 2023-02-13 12:01:56,344 INFO [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:56,345 DEBUG [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88/family1 2023-02-13 12:01:56,345 DEBUG [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88/family1 2023-02-13 12:01:56,346 INFO [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5b275f1912d0846361b5d2dd52a2f88 columnFamilyName family1 2023-02-13 12:01:56,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-02-13 12:01:56,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure ccad418e6257284c5dd66c3dc38417e0, server=jenkins-hbase16.apache.org,39857,1676289663697 in 187 msec 2023-02-13 12:01:56,346 INFO [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] regionserver.HStore(310): Store=c5b275f1912d0846361b5d2dd52a2f88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:56,347 INFO [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:56,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ccad418e6257284c5dd66c3dc38417e0, ASSIGN in 356 msec 2023-02-13 12:01:56,348 DEBUG [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88/family2 2023-02-13 12:01:56,348 DEBUG [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88/family2 2023-02-13 12:01:56,349 INFO [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5b275f1912d0846361b5d2dd52a2f88 columnFamilyName family2 2023-02-13 12:01:56,350 INFO [StoreOpener-c5b275f1912d0846361b5d2dd52a2f88-1] regionserver.HStore(310): Store=c5b275f1912d0846361b5d2dd52a2f88/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:56,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:56,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:56,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:01:56,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:01:56,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:01:56,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened c5b275f1912d0846361b5d2dd52a2f88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75384612, jitterRate=0.12331825494766235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:01:56,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for c5b275f1912d0846361b5d2dd52a2f88: Running coprocessor pre-open hook at 1676289716342Writing region info on filesystem at 1676289716342Initializing all the Stores at 1676289716343 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289716343Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289716344 (+1 ms)Cleaning up temporary data from old regions at 1676289716351 (+7 ms)Cleaning up detritus from prior splits at 1676289716352 (+1 ms)Running coprocessor post-open hooks at 1676289716355 (+3 ms)Region opened successfully at 1676289716355 2023-02-13 12:01:56,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88., pid=33, masterSystemTime=1676289716308 2023-02-13 12:01:56,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:56,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:56,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:56,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 28693c501211634a844bcf56f3d30bb6, NAME => 'testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 12:01:56,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:56,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:01:56,357 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c5b275f1912d0846361b5d2dd52a2f88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:56,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:56,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:56,358 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676289716357"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289716357"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289716357"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289716357"}]},"ts":"1676289716357"} 2023-02-13 12:01:56,359 INFO [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:56,360 DEBUG [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6/family1 2023-02-13 12:01:56,360 DEBUG [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6/family1 2023-02-13 12:01:56,361 INFO [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28693c501211634a844bcf56f3d30bb6 columnFamilyName family1 2023-02-13 12:01:56,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-02-13 12:01:56,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure c5b275f1912d0846361b5d2dd52a2f88, server=jenkins-hbase16.apache.org,39857,1676289663697 in 202 msec 2023-02-13 12:01:56,361 INFO [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] regionserver.HStore(310): Store=28693c501211634a844bcf56f3d30bb6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:56,362 INFO [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:56,362 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c5b275f1912d0846361b5d2dd52a2f88, ASSIGN in 371 msec 2023-02-13 12:01:56,363 DEBUG [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6/family2 2023-02-13 12:01:56,363 DEBUG [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6/family2 2023-02-13 12:01:56,363 INFO [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28693c501211634a844bcf56f3d30bb6 columnFamilyName family2 2023-02-13 12:01:56,364 INFO [StoreOpener-28693c501211634a844bcf56f3d30bb6-1] regionserver.HStore(310): Store=28693c501211634a844bcf56f3d30bb6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:01:56,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:56,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:56,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:01:56,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 28693c501211634a844bcf56f3d30bb6 2023-02-13 12:01:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:01:56,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 28693c501211634a844bcf56f3d30bb6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61937044, jitterRate=-0.07706612348556519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:01:56,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 28693c501211634a844bcf56f3d30bb6: Running coprocessor pre-open hook at 1676289716358Writing region info on filesystem at 1676289716358Initializing all the Stores at 1676289716358Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289716358Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289716358Cleaning up temporary data from old regions at 1676289716366 (+8 ms)Cleaning up detritus from prior splits at 1676289716366Running coprocessor post-open hooks at 1676289716371 (+5 ms)Region opened successfully at 1676289716371 2023-02-13 12:01:56,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6., pid=31, masterSystemTime=1676289716308 2023-02-13 12:01:56,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:56,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:56,373 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=28693c501211634a844bcf56f3d30bb6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:56,374 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676289716373"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289716373"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289716373"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289716373"}]},"ts":"1676289716373"} 2023-02-13 12:01:56,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-02-13 12:01:56,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 28693c501211634a844bcf56f3d30bb6, server=jenkins-hbase16.apache.org,39857,1676289663697 in 220 msec 2023-02-13 12:01:56,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-02-13 12:01:56,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=28693c501211634a844bcf56f3d30bb6, ASSIGN in 388 msec 2023-02-13 12:01:56,381 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:01:56,382 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289716382"}]},"ts":"1676289716382"} 2023-02-13 12:01:56,383 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-13 12:01:56,389 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:01:56,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.3020 sec 2023-02-13 12:01:57,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 12:01:57,203 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-13 12:01:57,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:57,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:57,217 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 12:01:57,217 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:57,217 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 12:01:57,217 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 12:01:57,218 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:57,218 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:57,230 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:57,230 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:57,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:57,231 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:57,231 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:57,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:57,232 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:57,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:57,232 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 12:01:57,232 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:57,232 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 12:01:57,233 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:57,233 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. started... 2023-02-13 12:01:57,233 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:57,233 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:01:57,233 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:57,233 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:57,233 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. started... 2023-02-13 12:01:57,234 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. started... 2023-02-13 12:01:57,234 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c5b275f1912d0846361b5d2dd52a2f88: 2023-02-13 12:01:57,233 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 28693c501211634a844bcf56f3d30bb6: 2023-02-13 12:01:57,235 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:57,234 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ccad418e6257284c5dd66c3dc38417e0 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-13 12:01:57,234 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:57,235 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:01:57,235 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:01:57,656 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ddf948395def4ef58904e6bdad7d071a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213ddf948395def4ef58904e6bdad7d071a 2023-02-13 12:01:58,065 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/.tmp/family1/a9ec8fc1deec424094b42efb6d819867 2023-02-13 12:01:58,073 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/.tmp/family1/a9ec8fc1deec424094b42efb6d819867 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/a9ec8fc1deec424094b42efb6d819867 2023-02-13 12:01:58,081 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/a9ec8fc1deec424094b42efb6d819867, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 12:01:58,082 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for ccad418e6257284c5dd66c3dc38417e0 in 848ms, sequenceid=5, compaction requested=false 2023-02-13 12:01:58,082 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-13 12:01:58,083 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ccad418e6257284c5dd66c3dc38417e0: 2023-02-13 12:01:58,083 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:58,083 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:01:58,083 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:01:58,083 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,083 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 12:01:58,083 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 12:01:58,114 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,114 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:58,114 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,114 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:58,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 12:01:58,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dfad284[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:58,115 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 12:01:58,116 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,122 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,122 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 12:01:58,122 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 12:01:58,122 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:58,123 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,123 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:58,130 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 12:01:58,130 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:58,131 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 12:01:58,130 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:58,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:58,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 12:01:58,133 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 12:01:58,134 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:58,134 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:58,134 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,134 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:58,139 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,139 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:58,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,139 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:58,139 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,140 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:58,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,168 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:58,168 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:58,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:58,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 12:01:58,168 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 12:01:58,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:58,168 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:58,168 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,169 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,169 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,169 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:58,169 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:58,169 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:58,169 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:58,169 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,269 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:58,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:58,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:01:58,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-13 12:01:58,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,283 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 12:01:58,283 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:58,283 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 12:01:58,283 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 12:01:58,284 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,284 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,297 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,297 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:58,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:58,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:58,298 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:58,298 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:01:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:01:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,301 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-13 12:01:58,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:58,302 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 12:01:58,302 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:01:58,302 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 12:01:58,302 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:58,302 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:58,302 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:01:58,303 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:01:58,302 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. started... 2023-02-13 12:01:58,303 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:58,303 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. started... 2023-02-13 12:01:58,302 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. started... 2023-02-13 12:01:58,303 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ccad418e6257284c5dd66c3dc38417e0 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-13 12:01:58,303 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c5b275f1912d0846361b5d2dd52a2f88: 2023-02-13 12:01:58,303 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:01:58,303 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 28693c501211634a844bcf56f3d30bb6: 2023-02-13 12:01:58,304 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:01:58,304 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:01:58,304 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:01:58,727 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a328eb73ae5b4a70aa909e5f69db8123 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213a328eb73ae5b4a70aa909e5f69db8123 2023-02-13 12:01:59,138 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/.tmp/family1/64dc1c3d76b742bc9c67a99a7c03231f 2023-02-13 12:01:59,150 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/.tmp/family1/64dc1c3d76b742bc9c67a99a7c03231f as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/64dc1c3d76b742bc9c67a99a7c03231f 2023-02-13 12:01:59,156 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/64dc1c3d76b742bc9c67a99a7c03231f, entries=2, sequenceid=9, filesize=5.0 K 2023-02-13 12:01:59,157 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for ccad418e6257284c5dd66c3dc38417e0 in 854ms, sequenceid=9, compaction requested=false 2023-02-13 12:01:59,157 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ccad418e6257284c5dd66c3dc38417e0: 2023-02-13 12:01:59,157 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:01:59,157 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:01:59,158 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:01:59,158 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,158 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 12:01:59,158 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 12:01:59,189 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,189 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:59,190 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,190 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:59,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 12:01:59,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@622f0836[Count = 0] remaining members to acquire global barrier 2023-02-13 12:01:59,193 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 12:01:59,193 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,203 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,203 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 12:01:59,203 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 12:01:59,203 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:01:59,203 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,203 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:01:59,214 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 12:01:59,214 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:59,214 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 12:01:59,214 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:01:59,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 12:01:59,218 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 12:01:59,218 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:01:59,218 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:01:59,218 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,218 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:01:59,228 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,228 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:59,228 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:01:59,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:01:59,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,229 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:01:59,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:59,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:59,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:01:59,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,231 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:01:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,239 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,239 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:01:59,239 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,239 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:01:59,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 12:01:59,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:01:59,239 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,240 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:01:59,240 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,240 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,240 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:01:59,240 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 12:01:59,239 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:01:59,240 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:01:59,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:01:59,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 12:01:59,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:01:59,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:01:59,340 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:01:59,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:01:59,351 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-13 12:01:59,355 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 12:01:59,356 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 12:01:59,357 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290319357 2023-02-13 12:01:59,357 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:01:59,358 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:01:59,358 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-13 12:01:59,358 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 12:01:59,359 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x4eb14fd7 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:01:59,371 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dcd56ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:01:59,371 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 12:02:00,212 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213204691fb2277432d82ececae6fcbf627 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213204691fb2277432d82ececae6fcbf627 2023-02-13 12:02:00,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 12:02:00,227 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:02:00,228 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36962, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:02:00,235 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:02:00,237 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41686, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:02:00,248 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/732982eb23b6449aafbc7b2059da8d5f first=Optional[k0] last=Optional[k1] 2023-02-13 12:02:00,248 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/732982eb23b6449aafbc7b2059da8d5f}] 2023-02-13 12:02:00,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/732982eb23b6449aafbc7b2059da8d5f for inclusion in ccad418e6257284c5dd66c3dc38417e0/family1 2023-02-13 12:02:00,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-13 12:02:00,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 12:02:00,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for ccad418e6257284c5dd66c3dc38417e0: 2023-02-13 12:02:00,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/732982eb23b6449aafbc7b2059da8d5f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testScannerOnBulkLoadRefHFiles__vsc2svad5ad4o038m63p8c18fgc8ocq2iuj738upojvj78gsvnjmgm1u4dkdmk8k/family1/732982eb23b6449aafbc7b2059da8d5f 2023-02-13 12:02:00,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testScannerOnBulkLoadRefHFiles__vsc2svad5ad4o038m63p8c18fgc8ocq2iuj738upojvj78gsvnjmgm1u4dkdmk8k/family1/732982eb23b6449aafbc7b2059da8d5f as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/194d982042134543b88207451d51fbdc_SeqId_12_ 2023-02-13 12:02:00,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testScannerOnBulkLoadRefHFiles__vsc2svad5ad4o038m63p8c18fgc8ocq2iuj738upojvj78gsvnjmgm1u4dkdmk8k/family1/732982eb23b6449aafbc7b2059da8d5f into ccad418e6257284c5dd66c3dc38417e0/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/194d982042134543b88207451d51fbdc_SeqId_12_ - updating store file list. 2023-02-13 12:02:00,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/194d982042134543b88207451d51fbdc_SeqId_12_ into ccad418e6257284c5dd66c3dc38417e0/family1 2023-02-13 12:02:00,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testScannerOnBulkLoadRefHFiles__vsc2svad5ad4o038m63p8c18fgc8ocq2iuj738upojvj78gsvnjmgm1u4dkdmk8k/family1/732982eb23b6449aafbc7b2059da8d5f into ccad418e6257284c5dd66c3dc38417e0/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/194d982042134543b88207451d51fbdc_SeqId_12_) 2023-02-13 12:02:00,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testScannerOnBulkLoadRefHFiles__vsc2svad5ad4o038m63p8c18fgc8ocq2iuj738upojvj78gsvnjmgm1u4dkdmk8k/family1/732982eb23b6449aafbc7b2059da8d5f 2023-02-13 12:02:00,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 12:02:00,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 12:02:00,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): ccad418e6257284c5dd66c3dc38417e0/family1 is initiating minor compaction (all files) 2023-02-13 12:02:00,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7e2e61f8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:00,272 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of ccad418e6257284c5dd66c3dc38417e0/family1 in testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:02:00,273 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/a9ec8fc1deec424094b42efb6d819867, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/64dc1c3d76b742bc9c67a99a7c03231f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/194d982042134543b88207451d51fbdc_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/.tmp, totalSize=15.1 K 2023-02-13 12:02:00,273 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting a9ec8fc1deec424094b42efb6d819867, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289717204 2023-02-13 12:02:00,274 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 64dc1c3d76b742bc9c67a99a7c03231f, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289717204 2023-02-13 12:02:00,274 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 194d982042134543b88207451d51fbdc_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289717204 2023-02-13 12:02:00,275 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 12:02:00,276 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:00,278 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213a328eb73ae5b4a70aa909e5f69db8123 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213a328eb73ae5b4a70aa909e5f69db8123 2023-02-13 12:02:00,279 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213ddf948395def4ef58904e6bdad7d071a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213ddf948395def4ef58904e6bdad7d071a 2023-02-13 12:02:00,279 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-13 12:02:00,279 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 12:02:00,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 12:02:00,280 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 12:02:00,280 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:00,281 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 12:02:00,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 927 msec 2023-02-13 12:02:00,286 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): ccad418e6257284c5dd66c3dc38417e0#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:02:00,313 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=247 (was 251), OpenFileDescriptor=610 (was 603) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 181), ProcessCount=165 (was 165), AvailableMemoryMB=6161 (was 6162) 2023-02-13 12:02:00,325 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=247, OpenFileDescriptor=610, MaxFileDescriptor=60000, SystemLoadAverage=167, ProcessCount=165, AvailableMemoryMB=6161 2023-02-13 12:02:00,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 12:02:00,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:00,331 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:02:00,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-13 12:02:00,332 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:02:00,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 12:02:00,333 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:02:00,334 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a empty. 2023-02-13 12:02:00,335 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:02:00,335 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-13 12:02:00,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 12:02:00,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 12:02:00,747 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 12:02:00,750 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => f38b3449a15ddc7b7f05721277b6b71a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:02:00,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 12:02:01,164 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:01,164 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing f38b3449a15ddc7b7f05721277b6b71a, disabling compactions & flushes 2023-02-13 12:02:01,164 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:01,165 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:01,165 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. after waiting 0 ms 2023-02-13 12:02:01,165 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:01,165 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:01,165 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for f38b3449a15ddc7b7f05721277b6b71a: Waiting for close lock at 1676289721164Disabling compacts and flushes for region at 1676289721164Disabling writes for close at 1676289721165 (+1 ms)Writing region close event to WAL at 1676289721165Closed at 1676289721165 2023-02-13 12:02:01,171 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:02:01,173 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676289721173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289721173"}]},"ts":"1676289721173"} 2023-02-13 12:02:01,176 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 12:02:01,178 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:02:01,178 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289721178"}]},"ts":"1676289721178"} 2023-02-13 12:02:01,180 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 12:02:01,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f38b3449a15ddc7b7f05721277b6b71a, ASSIGN}] 2023-02-13 12:02:01,225 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f38b3449a15ddc7b7f05721277b6b71a, ASSIGN 2023-02-13 12:02:01,226 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f38b3449a15ddc7b7f05721277b6b71a, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:02:01,377 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f38b3449a15ddc7b7f05721277b6b71a, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:01,377 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676289721377"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289721377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289721377"}]},"ts":"1676289721377"} 2023-02-13 12:02:01,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure f38b3449a15ddc7b7f05721277b6b71a, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:01,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 12:02:01,531 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/.tmp/family1/f0dbea1b7393421ebfed2c2ae58d4889 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/f0dbea1b7393421ebfed2c2ae58d4889 2023-02-13 12:02:01,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:01,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f38b3449a15ddc7b7f05721277b6b71a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:02:01,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:02:01,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:01,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:02:01,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:02:01,537 INFO [StoreOpener-f38b3449a15ddc7b7f05721277b6b71a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:02:01,538 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ccad418e6257284c5dd66c3dc38417e0/family1 of ccad418e6257284c5dd66c3dc38417e0 into f0dbea1b7393421ebfed2c2ae58d4889(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:02:01,538 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for ccad418e6257284c5dd66c3dc38417e0: 2023-02-13 12:02:01,539 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676289720272; duration=1sec 2023-02-13 12:02:01,539 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:01,539 DEBUG [StoreOpener-f38b3449a15ddc7b7f05721277b6b71a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1 2023-02-13 12:02:01,539 DEBUG [StoreOpener-f38b3449a15ddc7b7f05721277b6b71a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1 2023-02-13 12:02:01,539 INFO [StoreOpener-f38b3449a15ddc7b7f05721277b6b71a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f38b3449a15ddc7b7f05721277b6b71a columnFamilyName family1 2023-02-13 12:02:01,541 INFO [StoreOpener-f38b3449a15ddc7b7f05721277b6b71a-1] regionserver.HStore(310): Store=f38b3449a15ddc7b7f05721277b6b71a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:01,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:02:01,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:02:01,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:02:01,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:02:01,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened f38b3449a15ddc7b7f05721277b6b71a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70375264, jitterRate=0.048673152923583984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:02:01,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for f38b3449a15ddc7b7f05721277b6b71a: Running coprocessor pre-open hook at 1676289721536Writing region info on filesystem at 1676289721536Initializing all the Stores at 1676289721537 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676289721537Cleaning up temporary data from old regions at 1676289721543 (+6 ms)Cleaning up detritus from prior splits at 1676289721543Running coprocessor post-open hooks at 1676289721547 (+4 ms)Region opened successfully at 1676289721547 2023-02-13 12:02:01,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a., pid=37, masterSystemTime=1676289721531 2023-02-13 12:02:01,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:01,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:01,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f38b3449a15ddc7b7f05721277b6b71a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:01,550 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676289721550"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289721550"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289721550"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289721550"}]},"ts":"1676289721550"} 2023-02-13 12:02:01,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-13 12:02:01,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure f38b3449a15ddc7b7f05721277b6b71a, server=jenkins-hbase16.apache.org,39857,1676289663697 in 173 msec 2023-02-13 12:02:01,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-13 12:02:01,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f38b3449a15ddc7b7f05721277b6b71a, ASSIGN in 331 msec 2023-02-13 12:02:01,555 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:02:01,555 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289721555"}]},"ts":"1676289721555"} 2023-02-13 12:02:01,556 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 12:02:01,590 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:02:01,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.2620 sec 2023-02-13 12:02:01,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/a9ec8fc1deec424094b42efb6d819867, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/64dc1c3d76b742bc9c67a99a7c03231f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/194d982042134543b88207451d51fbdc_SeqId_12_] to archive 2023-02-13 12:02:01,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:01,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/a9ec8fc1deec424094b42efb6d819867 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/a9ec8fc1deec424094b42efb6d819867 2023-02-13 12:02:01,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/64dc1c3d76b742bc9c67a99a7c03231f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/64dc1c3d76b742bc9c67a99a7c03231f 2023-02-13 12:02:01,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/194d982042134543b88207451d51fbdc_SeqId_12_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/family1/194d982042134543b88207451d51fbdc_SeqId_12_ 2023-02-13 12:02:01,851 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:02:02,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 12:02:02,442 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-13 12:02:02,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:02,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:02,473 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:02,473 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:02,473 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:02,473 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:02,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:02,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:02,505 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:02,505 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:02,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:02,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:02,506 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:02,506 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:02,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:02,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:02,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:02,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:02,507 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:02,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:02,507 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:02,507 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:02,507 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:02,507 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:02,507 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:02,507 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:02,507 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:02,508 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 12:02:02,937 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307cca9fcf896d471b97b82d0ac19ba2eb to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307cca9fcf896d471b97b82d0ac19ba2eb 2023-02-13 12:02:03,345 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/26ae8574bd51407799d58f76d6c040d4 2023-02-13 12:02:03,363 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/26ae8574bd51407799d58f76d6c040d4 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/26ae8574bd51407799d58f76d6c040d4 2023-02-13 12:02:03,373 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/26ae8574bd51407799d58f76d6c040d4, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 12:02:03,374 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 866ms, sequenceid=5, compaction requested=false 2023-02-13 12:02:03,374 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:03,375 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:03,375 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:03,375 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:03,375 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:03,375 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,375 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:03,375 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:03,397 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,397 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:03,398 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,398 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:03,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:03,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@effb4db[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:03,401 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:03,401 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,412 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:03,412 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:03,412 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:03,412 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,412 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:03,422 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:03,422 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,422 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:03,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:03,422 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:03,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:03,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:03,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:03,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:03,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:03,430 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:03,431 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:03,431 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:03,431 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,431 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:03,439 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,439 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:03,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,439 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:03,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:03,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:03,440 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:03,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:03,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,442 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:03,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:03,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,453 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:03,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:03,453 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:03,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:03,554 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:03,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:03,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:03,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:03,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,560 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:03,560 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:03,560 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:03,560 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:03,560 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,560 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,570 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,570 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:03,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:03,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:03,570 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:03,570 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:03,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:03,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,571 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,571 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:02:03,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:03,571 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:03,571 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:03,571 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:03,571 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:03,571 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:03,571 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:03,572 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:03,572 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 12:02:03,989 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112838112d8052e644b7b30aed92138a81b1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112838112d8052e644b7b30aed92138a81b1 2023-02-13 12:02:04,398 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/3100b6ef10a340568b9966c783089e83 2023-02-13 12:02:04,411 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/3100b6ef10a340568b9966c783089e83 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/3100b6ef10a340568b9966c783089e83 2023-02-13 12:02:04,417 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/3100b6ef10a340568b9966c783089e83, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 12:02:04,418 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 846ms, sequenceid=9, compaction requested=false 2023-02-13 12:02:04,418 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:04,418 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:04,418 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:04,418 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:04,418 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,419 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:04,419 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:04,447 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,447 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:04,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:04,448 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,448 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:04,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:04,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33bfbe61[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:04,451 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:04,452 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,480 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,480 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:04,481 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:04,481 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:04,481 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,481 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:04,495 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:04,495 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:04,495 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,495 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:04,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:04,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:04,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:04,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:04,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:04,505 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:04,505 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:04,505 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:04,505 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,505 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:04,514 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,514 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:04,514 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:04,514 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:04,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:04,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,516 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,522 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,522 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:04,522 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,522 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:04,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:04,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:04,522 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:04,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:04,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:02:04,522 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:04,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:04,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:04,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,524 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:04,524 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:04,624 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:04,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:04,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:04,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:04,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,641 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:04,641 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:04,641 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:04,641 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:04,642 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,642 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,653 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:04,653 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:04,654 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:04,654 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:04,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,657 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,658 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:02:04,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:04,658 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:04,658 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:04,658 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:04,659 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:04,659 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:04,659 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:04,659 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:04,659 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:05,086 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201840f9f1f7f984c619e08a38f74672c89 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201840f9f1f7f984c619e08a38f74672c89 2023-02-13 12:02:05,397 DEBUG [regionserver/jenkins-hbase16:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 12:02:05,494 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/9ea2ccbd375b48b0bfdd5a81ac6874e8 2023-02-13 12:02:05,508 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/9ea2ccbd375b48b0bfdd5a81ac6874e8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9ea2ccbd375b48b0bfdd5a81ac6874e8 2023-02-13 12:02:05,513 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9ea2ccbd375b48b0bfdd5a81ac6874e8, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 12:02:05,514 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 855ms, sequenceid=13, compaction requested=true 2023-02-13 12:02:05,514 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:05,514 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:05,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:05,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:05,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:05,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:05,547 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,547 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:05,548 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,548 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:05,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:05,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8ea2460[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:05,552 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:05,552 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,561 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,562 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:05,562 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:05,562 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:05,562 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,562 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:05,572 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,572 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:05,572 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:05,573 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:05,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:05,582 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:05,582 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:05,582 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:05,582 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,582 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:05,595 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,595 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:05,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,595 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:05,597 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:05,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,601 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,614 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,614 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:05,614 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:05,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:05,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:05,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:05,614 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:05,614 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,614 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:05,615 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:05,615 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,615 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,615 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:02:05,615 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:05,615 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:05,716 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:05,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:05,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:05,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:05,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,729 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:05,729 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:05,729 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:05,729 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:05,729 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,730 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,739 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,739 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:05,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:05,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:05,739 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:05,739 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:05,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:05,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,741 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,741 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:02:05,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:05,741 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:05,741 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:05,741 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:05,741 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:05,742 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:05,742 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:05,742 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:05,742 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:05,762 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d8a88dc43d6a4aa1bc512362a830d83b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d8a88dc43d6a4aa1bc512362a830d83b 2023-02-13 12:02:06,167 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/5fa7a04772864121a00511aeeac4bdc6 2023-02-13 12:02:06,178 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/5fa7a04772864121a00511aeeac4bdc6 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/5fa7a04772864121a00511aeeac4bdc6 2023-02-13 12:02:06,186 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/5fa7a04772864121a00511aeeac4bdc6, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 12:02:06,187 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 445ms, sequenceid=17, compaction requested=true 2023-02-13 12:02:06,187 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:06,187 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:06,187 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:06,187 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:06,187 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,187 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:06,187 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:06,197 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,197 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:06,198 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,198 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:06,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:06,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:06,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:06,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:06,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@121ef3f3[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:06,202 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:06,202 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,255 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,256 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:06,256 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:06,256 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:06,256 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,256 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:06,264 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:06,264 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,264 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:06,264 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:06,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:06,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:06,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:06,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:06,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:06,272 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:06,272 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:06,272 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:06,272 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,272 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:06,280 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,280 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:06,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,281 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:06,282 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,285 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,297 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,297 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:06,297 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:06,297 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:06,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:06,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:06,297 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:06,297 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:06,298 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:06,298 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:06,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:02:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:06,298 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,299 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,299 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,299 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,399 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:06,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:06,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:06,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:06,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,411 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:06,411 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:06,412 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:06,412 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:06,413 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,413 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,439 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:06,439 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:06,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:06,440 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:06,440 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:06,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:06,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,443 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,443 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:02:06,443 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:06,443 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:06,444 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:06,444 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:06,444 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:06,444 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:06,444 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:06,445 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:06,445 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:06,862 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122806551aa6f7384d21a6c5a4998972506b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122806551aa6f7384d21a6c5a4998972506b 2023-02-13 12:02:07,039 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:02:07,077 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:02:07,077 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4eb14fd7 to 127.0.0.1:62284 2023-02-13 12:02:07,077 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:02:07,077 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:02:07,077 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b0f2f39 to 127.0.0.1:62284 2023-02-13 12:02:07,078 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:02:07,078 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:02:07,078 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62dd8dda to 127.0.0.1:62284 2023-02-13 12:02:07,078 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:02:07,268 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/43ddbb34c1094153a1d50fe117f90ba4 2023-02-13 12:02:07,280 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/43ddbb34c1094153a1d50fe117f90ba4 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/43ddbb34c1094153a1d50fe117f90ba4 2023-02-13 12:02:07,285 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/43ddbb34c1094153a1d50fe117f90ba4, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 12:02:07,286 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 841ms, sequenceid=21, compaction requested=true 2023-02-13 12:02:07,286 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:07,286 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:07,286 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:07,286 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:07,286 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,286 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:07,286 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:07,297 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,297 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:07,297 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,297 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:07,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:07,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6134d407[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:07,301 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:07,301 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,311 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,312 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:07,312 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:07,312 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:07,312 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,312 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:07,322 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:07,322 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:07,322 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:07,322 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:07,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:07,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:07,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:07,330 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:07,330 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:07,331 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:07,331 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,331 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:07,339 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,339 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:07,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,339 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:07,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:07,340 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:07,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,342 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,353 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,353 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:07,353 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:07,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:07,353 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:07,353 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,353 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,353 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,354 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,354 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,354 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:07,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:07,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:07,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:02:07,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:07,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:07,354 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:07,355 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:07,455 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:07,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:07,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:07,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:07,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,470 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:07,470 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:07,470 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:07,470 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:07,471 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,471 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,480 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:07,480 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:07,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:07,481 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:07,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,481 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:07,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:07,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,483 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,484 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:02:07,484 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:07,484 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:07,484 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:07,484 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:07,485 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:07,485 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:07,485 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:07,485 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:07,485 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:07,904 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e93be7259ea34eb986585acee231f867 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231e93be7259ea34eb986585acee231f867 2023-02-13 12:02:08,311 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/6054e8b760c64c8494c387730f2f906a 2023-02-13 12:02:08,323 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/6054e8b760c64c8494c387730f2f906a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6054e8b760c64c8494c387730f2f906a 2023-02-13 12:02:08,328 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6054e8b760c64c8494c387730f2f906a, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 12:02:08,329 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 844ms, sequenceid=25, compaction requested=true 2023-02-13 12:02:08,329 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:08,329 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:08,329 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:08,330 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:08,330 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,330 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:08,330 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:08,364 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,364 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:08,364 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,365 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:08,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:08,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:08,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:08,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:08,369 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:08,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fb632f6[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:08,369 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,378 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,378 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:08,379 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:08,379 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:08,379 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,379 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:08,389 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:08,389 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:08,389 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:08,389 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:08,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:08,399 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:08,400 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:08,400 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:08,400 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,400 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:08,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:08,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:08,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:08,413 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,415 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,428 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,428 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:08,428 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,428 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:08,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:08,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:08,428 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:08,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:02:08,428 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,429 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,429 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,428 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:08,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:08,429 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,428 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:08,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:08,429 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:08,529 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:08,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:08,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:08,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:08,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,546 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:08,547 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:08,547 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:08,547 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:08,548 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,548 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,555 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,555 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:08,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:08,556 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:08,557 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,560 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:02:08,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:08,560 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:08,560 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:08,560 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:08,560 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:08,560 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:08,561 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:08,561 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:08,561 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:08,984 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101151ce0c647ea4caa80fbb2c8572abe4c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101151ce0c647ea4caa80fbb2c8572abe4c 2023-02-13 12:02:09,392 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/aa1ff1f8d9df408f84952820f0d1f42a 2023-02-13 12:02:09,404 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/aa1ff1f8d9df408f84952820f0d1f42a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/aa1ff1f8d9df408f84952820f0d1f42a 2023-02-13 12:02:09,410 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/aa1ff1f8d9df408f84952820f0d1f42a, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 12:02:09,411 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 850ms, sequenceid=29, compaction requested=true 2023-02-13 12:02:09,411 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:09,411 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:09,411 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:09,411 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:09,411 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,411 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:09,411 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:09,439 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,439 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:09,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:09,440 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,440 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:09,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:09,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:09,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:09,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:09,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7626da44[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:09,444 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:09,445 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,455 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,456 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:09,456 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:09,456 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:09,456 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,456 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:09,464 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:09,464 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:09,464 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:09,464 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:09,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:09,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:09,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:09,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:09,474 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:09,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:09,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:09,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,474 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:09,480 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,480 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:09,480 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:09,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:09,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:09,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:09,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:09,481 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:09,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,482 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:09,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,515 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,515 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,515 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,515 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:09,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:09,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:09,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:09,515 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:09,515 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:09,515 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,516 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:09,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:09,516 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:09,516 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,517 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,517 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,617 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:09,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:09,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:09,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:09,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,635 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:09,635 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:09,635 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:09,635 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:09,637 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,637 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,647 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:09,647 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:09,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:09,648 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:09,648 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:09,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:09,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,650 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,650 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:02:09,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:09,651 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:09,651 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:09,651 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:09,651 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:09,651 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:09,652 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:09,652 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:09,652 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:10,081 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ffebc62921334d7c9a638853149e2064 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ffebc62921334d7c9a638853149e2064 2023-02-13 12:02:10,488 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/6a62ee48ad1442afbb6742a4d19169a5 2023-02-13 12:02:10,501 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/6a62ee48ad1442afbb6742a4d19169a5 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6a62ee48ad1442afbb6742a4d19169a5 2023-02-13 12:02:10,508 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6a62ee48ad1442afbb6742a4d19169a5, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 12:02:10,509 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 857ms, sequenceid=33, compaction requested=true 2023-02-13 12:02:10,509 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:10,509 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:10,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:10,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:10,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:10,509 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:10,539 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,539 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:10,539 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,540 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:10,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:10,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13c23e18[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:10,544 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:10,544 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,553 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,553 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:10,553 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:10,553 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:10,553 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:10,563 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:10,563 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:10,563 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,563 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:10,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:10,567 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:10,567 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:10,567 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:10,567 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,567 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:10,578 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,578 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,578 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:10,579 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:10,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:10,581 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,588 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,588 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:10,588 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:10,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:10,588 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,588 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:10,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:10,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:10,588 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:10,589 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:10,589 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:10,589 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:10,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:02:10,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:10,589 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,589 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,589 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,689 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:10,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:10,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:10,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:10,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,700 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:10,700 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:10,700 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:10,700 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:10,701 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,701 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,711 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:10,711 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:10,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:10,712 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:10,712 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:10,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,714 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,715 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:02:10,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:10,715 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:10,715 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:10,715 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:10,716 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:10,716 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:10,716 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:10,716 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:10,716 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:11,141 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077cab5782cb194f44abf11f688521fbc6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509077cab5782cb194f44abf11f688521fbc6 2023-02-13 12:02:11,551 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/73298644777543c595f245563f5cbf4b 2023-02-13 12:02:11,565 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/73298644777543c595f245563f5cbf4b as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/73298644777543c595f245563f5cbf4b 2023-02-13 12:02:11,570 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/73298644777543c595f245563f5cbf4b, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 12:02:11,571 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 855ms, sequenceid=37, compaction requested=true 2023-02-13 12:02:11,571 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:11,571 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:11,571 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:11,572 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:11,572 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,572 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:11,572 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:11,605 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,605 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:11,606 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,606 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:11,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:11,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:11,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:11,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:11,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5411448b[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:11,610 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:11,610 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,619 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,620 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:11,620 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:11,620 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:11,621 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,621 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:11,630 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:11,630 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:11,630 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,631 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:11,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:11,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:11,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:11,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:11,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:11,640 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:11,640 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:11,640 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:11,640 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,640 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:11,647 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,647 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:11,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,647 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:11,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:11,648 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,650 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,661 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,661 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:11,661 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:11,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:11,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:11,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:11,661 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:02:11,661 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:11,662 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:11,662 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,662 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:11,663 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,663 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:11,663 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,663 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,763 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:11,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:11,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:11,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:11,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,770 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:11,770 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:11,770 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 12:02:11,770 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 12:02:11,770 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,770 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,780 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,780 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:11,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:11,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:11,780 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:11,781 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:11,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,782 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,782 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 12:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:11,782 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 12:02:11,782 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:11,782 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 12:02:11,782 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:11,782 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:11,783 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:11,783 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. started... 2023-02-13 12:02:11,783 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38b3449a15ddc7b7f05721277b6b71a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:12,205 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d4829776544d4b2db9fa379945d4257d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120d4829776544d4b2db9fa379945d4257d 2023-02-13 12:02:12,613 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/cea8992d13704e4f8c939cad049ac20c 2023-02-13 12:02:12,626 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/cea8992d13704e4f8c939cad049ac20c as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cea8992d13704e4f8c939cad049ac20c 2023-02-13 12:02:12,633 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cea8992d13704e4f8c939cad049ac20c, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 12:02:12,634 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f38b3449a15ddc7b7f05721277b6b71a in 851ms, sequenceid=41, compaction requested=true 2023-02-13 12:02:12,634 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:12,634 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:12,635 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:12,635 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:12,635 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,635 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 12:02:12,635 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 12:02:12,663 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,663 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:12,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:12,664 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,664 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:12,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:12,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 12:02:12,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aaeed7d[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:12,667 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 12:02:12,667 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,672 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,672 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 12:02:12,672 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 12:02:12,672 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:12,672 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,672 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:12,680 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,680 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 12:02:12,680 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:12,680 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 12:02:12,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:12,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:12,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:12,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:12,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:12,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:12,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:02:12,687 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 12:02:12,687 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:12,687 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:12,687 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,687 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:12,716 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,716 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:12,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:12,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,716 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:12,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:12,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:12,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:12,718 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:12,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,721 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:12,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,738 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:12,738 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:12,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 12:02:12,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:12,739 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:12,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 12:02:12,739 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:12,739 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,740 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:12,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:12,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:12,740 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,740 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:12,740 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:12,740 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,741 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,741 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,841 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:12,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:12,846 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-13 12:02:12,850 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:02:12,852 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:02:12,854 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:12,854 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290332854 2023-02-13 12:02:12,858 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:02:12,859 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 12:02:12,859 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:02:12,860 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x7ef1e9aa to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:02:12,872 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5074e379, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:02:12,872 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:13,725 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037dc3f432031a4923a9ebdac431bc85b6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601037dc3f432031a4923a9ebdac431bc85b6 2023-02-13 12:02:13,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:02:13,740 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:02:13,741 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46416, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:02:13,747 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:02:13,749 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:39520, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:02:13,758 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f146e382935d42e8bb645c14af9dc41d first=Optional[r3] last=Optional[r6] 2023-02-13 12:02:13,759 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f146e382935d42e8bb645c14af9dc41d}] 2023-02-13 12:02:13,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f146e382935d42e8bb645c14af9dc41d for inclusion in f38b3449a15ddc7b7f05721277b6b71a/family1 2023-02-13 12:02:13,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 12:02:13,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:02:13,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:13,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f146e382935d42e8bb645c14af9dc41d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m8dt5jo18nmkep5scg165nnvqqm1k8njpu1h1s605qjkkk876nmn0c3la8jusidi/family1/f146e382935d42e8bb645c14af9dc41d 2023-02-13 12:02:13,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m8dt5jo18nmkep5scg165nnvqqm1k8njpu1h1s605qjkkk876nmn0c3la8jusidi/family1/f146e382935d42e8bb645c14af9dc41d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9f61139fb39c4d33854dd591c36690cd_SeqId_44_ 2023-02-13 12:02:13,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m8dt5jo18nmkep5scg165nnvqqm1k8njpu1h1s605qjkkk876nmn0c3la8jusidi/family1/f146e382935d42e8bb645c14af9dc41d into f38b3449a15ddc7b7f05721277b6b71a/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9f61139fb39c4d33854dd591c36690cd_SeqId_44_ - updating store file list. 2023-02-13 12:02:13,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9f61139fb39c4d33854dd591c36690cd_SeqId_44_ into f38b3449a15ddc7b7f05721277b6b71a/family1 2023-02-13 12:02:13,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m8dt5jo18nmkep5scg165nnvqqm1k8njpu1h1s605qjkkk876nmn0c3la8jusidi/family1/f146e382935d42e8bb645c14af9dc41d into f38b3449a15ddc7b7f05721277b6b71a/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9f61139fb39c4d33854dd591c36690cd_SeqId_44_) 2023-02-13 12:02:13,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m8dt5jo18nmkep5scg165nnvqqm1k8njpu1h1s605qjkkk876nmn0c3la8jusidi/family1/f146e382935d42e8bb645c14af9dc41d 2023-02-13 12:02:13,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 12:02:13,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 12:02:13,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): f38b3449a15ddc7b7f05721277b6b71a/family1 is initiating minor compaction 2023-02-13 12:02:13,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@fe6ce6e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:13,780 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f38b3449a15ddc7b7f05721277b6b71a/family1 in testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:13,780 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/3100b6ef10a340568b9966c783089e83, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9ea2ccbd375b48b0bfdd5a81ac6874e8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/5fa7a04772864121a00511aeeac4bdc6, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/43ddbb34c1094153a1d50fe117f90ba4, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6054e8b760c64c8494c387730f2f906a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/aa1ff1f8d9df408f84952820f0d1f42a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6a62ee48ad1442afbb6742a4d19169a5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/73298644777543c595f245563f5cbf4b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cea8992d13704e4f8c939cad049ac20c, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9f61139fb39c4d33854dd591c36690cd_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp, totalSize=50.0 K 2023-02-13 12:02:13,780 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 3100b6ef10a340568b9966c783089e83, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 12:02:13,780 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 9ea2ccbd375b48b0bfdd5a81ac6874e8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 12:02:13,780 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 5fa7a04772864121a00511aeeac4bdc6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 12:02:13,781 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 43ddbb34c1094153a1d50fe117f90ba4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 12:02:13,781 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 6054e8b760c64c8494c387730f2f906a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 12:02:13,781 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting aa1ff1f8d9df408f84952820f0d1f42a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 12:02:13,781 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 6a62ee48ad1442afbb6742a4d19169a5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 12:02:13,781 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 73298644777543c595f245563f5cbf4b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 12:02:13,781 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting cea8992d13704e4f8c939cad049ac20c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 12:02:13,781 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 9f61139fb39c4d33854dd591c36690cd_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 12:02:13,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:02:13,784 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:13,785 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122806551aa6f7384d21a6c5a4998972506b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122806551aa6f7384d21a6c5a4998972506b 2023-02-13 12:02:13,786 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231e93be7259ea34eb986585acee231f867 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231e93be7259ea34eb986585acee231f867 2023-02-13 12:02:13,788 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101151ce0c647ea4caa80fbb2c8572abe4c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101151ce0c647ea4caa80fbb2c8572abe4c 2023-02-13 12:02:13,789 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ffebc62921334d7c9a638853149e2064 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ffebc62921334d7c9a638853149e2064 2023-02-13 12:02:13,789 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 12:02:13,789 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 12:02:13,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:13,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:13,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:13,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:13,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:13,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:13,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:13,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:13,805 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): f38b3449a15ddc7b7f05721277b6b71a#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:02:14,630 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205457634f3353a4a38b8479640fde6230f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205457634f3353a4a38b8479640fde6230f 2023-02-13 12:02:14,631 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/cf4007824baf4195bf9cb0b386b88e28 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cf4007824baf4195bf9cb0b386b88e28 2023-02-13 12:02:14,631 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:02:14,636 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f38b3449a15ddc7b7f05721277b6b71a/family1 of f38b3449a15ddc7b7f05721277b6b71a into cf4007824baf4195bf9cb0b386b88e28(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:02:14,636 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:14,637 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676289733780; duration=0sec 2023-02-13 12:02:14,637 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:14,657 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/beff575e62534d02a2112671583f7fdb first=Optional[r00] last=Optional[r2] 2023-02-13 12:02:14,657 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/beff575e62534d02a2112671583f7fdb}] 2023-02-13 12:02:14,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/beff575e62534d02a2112671583f7fdb for inclusion in f38b3449a15ddc7b7f05721277b6b71a/family1 2023-02-13 12:02:14,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 12:02:14,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:02:14,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:14,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/beff575e62534d02a2112671583f7fdb to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gl7qu0tqal2tisfousm89pd7qs1vevjue48k8o9q6g1qmgfrur5f1uvhicfai9je/family1/beff575e62534d02a2112671583f7fdb 2023-02-13 12:02:14,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gl7qu0tqal2tisfousm89pd7qs1vevjue48k8o9q6g1qmgfrur5f1uvhicfai9je/family1/beff575e62534d02a2112671583f7fdb as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/f7875f76b11a468a91c00663efe0cdf0_SeqId_47_ 2023-02-13 12:02:14,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gl7qu0tqal2tisfousm89pd7qs1vevjue48k8o9q6g1qmgfrur5f1uvhicfai9je/family1/beff575e62534d02a2112671583f7fdb into f38b3449a15ddc7b7f05721277b6b71a/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/f7875f76b11a468a91c00663efe0cdf0_SeqId_47_ - updating store file list. 2023-02-13 12:02:14,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/f7875f76b11a468a91c00663efe0cdf0_SeqId_47_ into f38b3449a15ddc7b7f05721277b6b71a/family1 2023-02-13 12:02:14,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gl7qu0tqal2tisfousm89pd7qs1vevjue48k8o9q6g1qmgfrur5f1uvhicfai9je/family1/beff575e62534d02a2112671583f7fdb into f38b3449a15ddc7b7f05721277b6b71a/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/f7875f76b11a468a91c00663efe0cdf0_SeqId_47_) 2023-02-13 12:02:14,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gl7qu0tqal2tisfousm89pd7qs1vevjue48k8o9q6g1qmgfrur5f1uvhicfai9je/family1/beff575e62534d02a2112671583f7fdb 2023-02-13 12:02:14,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 12:02:14,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 12:02:14,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): f38b3449a15ddc7b7f05721277b6b71a/family1 is initiating minor compaction (all files) 2023-02-13 12:02:14,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2f5b6ea5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 12:02:14,671 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f38b3449a15ddc7b7f05721277b6b71a/family1 in testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:02:14,671 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/26ae8574bd51407799d58f76d6c040d4, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cf4007824baf4195bf9cb0b386b88e28, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/f7875f76b11a468a91c00663efe0cdf0_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp, totalSize=337.0 K 2023-02-13 12:02:14,671 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 26ae8574bd51407799d58f76d6c040d4, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807319 2023-02-13 12:02:14,671 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting cf4007824baf4195bf9cb0b386b88e28, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207319 2023-02-13 12:02:14,672 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting f7875f76b11a468a91c00663efe0cdf0_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878807319 2023-02-13 12:02:14,672 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:02:14,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:14,675 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307cca9fcf896d471b97b82d0ac19ba2eb to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307cca9fcf896d471b97b82d0ac19ba2eb 2023-02-13 12:02:14,676 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201840f9f1f7f984c619e08a38f74672c89 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201840f9f1f7f984c619e08a38f74672c89 2023-02-13 12:02:14,677 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d8a88dc43d6a4aa1bc512362a830d83b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d8a88dc43d6a4aa1bc512362a830d83b 2023-02-13 12:02:14,677 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-13 12:02:14,677 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 12:02:14,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 12:02:14,678 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 12:02:14,678 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:14,679 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:02:14,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8310 sec 2023-02-13 12:02:14,691 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): f38b3449a15ddc7b7f05721277b6b71a#family1#compaction#50 average throughput is 15.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:02:14,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/3100b6ef10a340568b9966c783089e83, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9ea2ccbd375b48b0bfdd5a81ac6874e8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/5fa7a04772864121a00511aeeac4bdc6, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/43ddbb34c1094153a1d50fe117f90ba4, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6054e8b760c64c8494c387730f2f906a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/aa1ff1f8d9df408f84952820f0d1f42a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6a62ee48ad1442afbb6742a4d19169a5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/73298644777543c595f245563f5cbf4b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cea8992d13704e4f8c939cad049ac20c, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9f61139fb39c4d33854dd591c36690cd_SeqId_44_] to archive 2023-02-13 12:02:14,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:14,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/3100b6ef10a340568b9966c783089e83 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/3100b6ef10a340568b9966c783089e83 2023-02-13 12:02:14,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9ea2ccbd375b48b0bfdd5a81ac6874e8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9ea2ccbd375b48b0bfdd5a81ac6874e8 2023-02-13 12:02:14,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/5fa7a04772864121a00511aeeac4bdc6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/5fa7a04772864121a00511aeeac4bdc6 2023-02-13 12:02:14,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/43ddbb34c1094153a1d50fe117f90ba4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/43ddbb34c1094153a1d50fe117f90ba4 2023-02-13 12:02:14,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6054e8b760c64c8494c387730f2f906a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6054e8b760c64c8494c387730f2f906a 2023-02-13 12:02:14,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/aa1ff1f8d9df408f84952820f0d1f42a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/aa1ff1f8d9df408f84952820f0d1f42a 2023-02-13 12:02:14,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6a62ee48ad1442afbb6742a4d19169a5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/6a62ee48ad1442afbb6742a4d19169a5 2023-02-13 12:02:14,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/73298644777543c595f245563f5cbf4b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/73298644777543c595f245563f5cbf4b 2023-02-13 12:02:14,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cea8992d13704e4f8c939cad049ac20c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cea8992d13704e4f8c939cad049ac20c 2023-02-13 12:02:14,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9f61139fb39c4d33854dd591c36690cd_SeqId_44_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/9f61139fb39c4d33854dd591c36690cd_SeqId_44_ 2023-02-13 12:02:14,781 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=245 (was 247), OpenFileDescriptor=592 (was 610), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=138 (was 167), ProcessCount=165 (was 165), AvailableMemoryMB=6096 (was 6161) 2023-02-13 12:02:14,791 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=245, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=138, ProcessCount=165, AvailableMemoryMB=6095 2023-02-13 12:02:14,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 12:02:14,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:14,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:02:14,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-13 12:02:14,796 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:02:14,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 12:02:14,798 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:14,798 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003 empty. 2023-02-13 12:02:14,799 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:14,799 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-13 12:02:14,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 12:02:15,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 12:02:15,207 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 12:02:15,210 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 296433c6c439db3f898b5e6f399bb003, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:02:15,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 12:02:15,619 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:15,619 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing 296433c6c439db3f898b5e6f399bb003, disabling compactions & flushes 2023-02-13 12:02:15,620 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:15,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:15,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. after waiting 0 ms 2023-02-13 12:02:15,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:15,620 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:15,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for 296433c6c439db3f898b5e6f399bb003: Waiting for close lock at 1676289735619Disabling compacts and flushes for region at 1676289735619Disabling writes for close at 1676289735620 (+1 ms)Writing region close event to WAL at 1676289735620Closed at 1676289735620 2023-02-13 12:02:15,625 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:02:15,627 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289735627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289735627"}]},"ts":"1676289735627"} 2023-02-13 12:02:15,631 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 12:02:15,632 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:02:15,632 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289735632"}]},"ts":"1676289735632"} 2023-02-13 12:02:15,633 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-13 12:02:15,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, ASSIGN}] 2023-02-13 12:02:15,682 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, ASSIGN 2023-02-13 12:02:15,683 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:02:15,835 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:15,835 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289735834"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289735834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289735834"}]},"ts":"1676289735834"} 2023-02-13 12:02:15,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:15,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 12:02:15,927 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/.tmp/family1/fe58b52d56c543ed87f97dee83827702 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/fe58b52d56c543ed87f97dee83827702 2023-02-13 12:02:15,937 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f38b3449a15ddc7b7f05721277b6b71a/family1 of f38b3449a15ddc7b7f05721277b6b71a into fe58b52d56c543ed87f97dee83827702(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:02:15,938 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f38b3449a15ddc7b7f05721277b6b71a: 2023-02-13 12:02:15,938 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1676289734670; duration=1sec 2023-02-13 12:02:15,938 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:15,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:15,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 296433c6c439db3f898b5e6f399bb003, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:02:16,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:16,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:16,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:16,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:16,005 INFO [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:16,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/26ae8574bd51407799d58f76d6c040d4, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cf4007824baf4195bf9cb0b386b88e28, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/f7875f76b11a468a91c00663efe0cdf0_SeqId_47_] to archive 2023-02-13 12:02:16,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:16,011 DEBUG [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:16,011 DEBUG [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:16,011 INFO [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 296433c6c439db3f898b5e6f399bb003 columnFamilyName family1 2023-02-13 12:02:16,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/26ae8574bd51407799d58f76d6c040d4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/26ae8574bd51407799d58f76d6c040d4 2023-02-13 12:02:16,013 INFO [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] regionserver.HStore(310): Store=296433c6c439db3f898b5e6f399bb003/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:16,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cf4007824baf4195bf9cb0b386b88e28 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/cf4007824baf4195bf9cb0b386b88e28 2023-02-13 12:02:16,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:16,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:16,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/f7875f76b11a468a91c00663efe0cdf0_SeqId_47_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/family1/f7875f76b11a468a91c00663efe0cdf0_SeqId_47_ 2023-02-13 12:02:16,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:16,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:02:16,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 296433c6c439db3f898b5e6f399bb003; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73406013, jitterRate=0.09383483231067657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:02:16,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 296433c6c439db3f898b5e6f399bb003: Running coprocessor pre-open hook at 1676289736000Writing region info on filesystem at 1676289736000Initializing all the Stores at 1676289736002 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676289736003 (+1 ms)Cleaning up temporary data from old regions at 1676289736015 (+12 ms)Cleaning up detritus from prior splits at 1676289736015Running coprocessor post-open hooks at 1676289736021 (+6 ms)Region opened successfully at 1676289736021 2023-02-13 12:02:16,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003., pid=41, masterSystemTime=1676289735993 2023-02-13 12:02:16,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:16,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:16,023 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:16,024 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289736023"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289736023"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289736023"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289736023"}]},"ts":"1676289736023"} 2023-02-13 12:02:16,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-13 12:02:16,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697 in 187 msec 2023-02-13 12:02:16,028 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-13 12:02:16,028 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, ASSIGN in 347 msec 2023-02-13 12:02:16,029 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:02:16,029 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289736029"}]},"ts":"1676289736029"} 2023-02-13 12:02:16,030 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-13 12:02:16,064 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:02:16,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.2720 sec 2023-02-13 12:02:16,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 12:02:16,906 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-13 12:02:16,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:16,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:16,934 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:16,934 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:16,934 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:16,934 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:16,934 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:16,934 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:16,963 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:16,963 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:16,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:16,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:16,964 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:16,964 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:16,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:16,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:16,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:16,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:16,965 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:16,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:16,965 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:16,965 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:16,965 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:16,965 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:16,965 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:16,965 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:16,966 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:16,966 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 12:02:17,397 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130363cec0fc74343eebec98799815b7d12 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130363cec0fc74343eebec98799815b7d12 2023-02-13 12:02:17,506 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:17,805 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/6e7073f85e9b490cb1d8ed8b34f141cf 2023-02-13 12:02:17,821 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/6e7073f85e9b490cb1d8ed8b34f141cf as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6e7073f85e9b490cb1d8ed8b34f141cf 2023-02-13 12:02:17,830 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6e7073f85e9b490cb1d8ed8b34f141cf, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-13 12:02:17,831 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 865ms, sequenceid=5, compaction requested=false 2023-02-13 12:02:17,832 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:17,833 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:17,833 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:17,833 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:17,833 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,833 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:17,833 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:17,855 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,855 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:17,856 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,856 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:17,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:17,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a1afa96[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:17,860 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:17,861 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,869 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,869 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:17,869 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:17,870 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:17,870 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,870 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:17,880 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,880 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:17,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:17,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:17,880 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:17,880 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:17,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:17,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:17,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:17,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:17,885 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:17,885 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:17,885 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:17,885 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,885 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:17,897 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,897 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:17,897 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:17,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:17,898 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,901 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,913 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,913 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:17,913 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,914 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,914 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:17,914 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:17,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:17,914 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:17,914 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 12:02:17,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:17,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:17,914 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:17,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:17,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:17,914 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:17,915 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:17,915 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:18,015 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:18,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:18,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:18,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:18,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,030 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:18,030 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:18,030 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:18,030 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:18,030 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,030 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,038 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:18,038 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:18,039 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,039 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:18,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,042 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,042 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 12:02:18,042 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,042 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:18,042 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:18,042 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:18,043 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:18,043 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:18,043 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:18,043 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:18,043 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 12:02:18,472 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280763cd5f2dfb4460a01c9823eada485b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511280763cd5f2dfb4460a01c9823eada485b 2023-02-13 12:02:18,878 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/4dfac0fb2f7e4287873cdbd7d3cf4cb0 2023-02-13 12:02:18,884 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/4dfac0fb2f7e4287873cdbd7d3cf4cb0 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/4dfac0fb2f7e4287873cdbd7d3cf4cb0 2023-02-13 12:02:18,889 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/4dfac0fb2f7e4287873cdbd7d3cf4cb0, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 12:02:18,890 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 847ms, sequenceid=9, compaction requested=false 2023-02-13 12:02:18,890 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:18,890 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:18,890 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:18,890 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:18,890 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,891 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:18,891 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:18,921 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,921 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:18,922 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,922 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:18,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:18,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@82a2733[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:18,926 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:18,926 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,936 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,936 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:18,936 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:18,936 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:18,936 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,936 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:18,946 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:18,946 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:18,946 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,946 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:18,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:18,950 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:18,950 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:18,950 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:18,951 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,951 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:18,961 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,961 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:18,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,961 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:18,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:18,962 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:18,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,964 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:18,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,989 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,989 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,989 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,989 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:18,990 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:18,990 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:18,989 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:18,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:18,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:18,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:18,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 12:02:18,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:18,990 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,991 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:18,991 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:18,991 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,991 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:18,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:18,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:19,091 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:19,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:19,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:19,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:19,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:19,101 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:19,101 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:19,101 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:19,101 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:19,102 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:19,102 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:19,113 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:19,113 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:19,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:19,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:19,114 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:19,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:19,114 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:19,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:19,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:19,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:19,114 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:19,115 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 12:02:19,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:19,115 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:19,115 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:19,115 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:19,115 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:19,115 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:19,115 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:19,115 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:19,115 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:19,539 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a74afd76003441038ffb876c73371920 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201a74afd76003441038ffb876c73371920 2023-02-13 12:02:19,952 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/f5f1697989af4d1482e4b2c3632a6826 2023-02-13 12:02:19,965 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/f5f1697989af4d1482e4b2c3632a6826 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f5f1697989af4d1482e4b2c3632a6826 2023-02-13 12:02:19,971 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f5f1697989af4d1482e4b2c3632a6826, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 12:02:19,972 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 857ms, sequenceid=13, compaction requested=true 2023-02-13 12:02:19,972 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:19,972 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:19,972 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:19,972 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:19,972 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:19,972 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:19,972 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:20,005 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,005 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:20,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:20,005 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,005 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:20,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:20,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:20,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:20,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:20,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56c11fa1[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:20,007 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:20,008 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,013 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,013 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:20,013 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:20,014 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:20,014 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,014 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:20,021 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:20,022 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:20,022 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:20,021 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:20,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:20,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:20,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:20,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:20,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:20,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:20,029 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:20,029 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:20,029 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:20,029 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,029 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:20,038 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,038 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,039 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:20,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:20,040 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:20,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,044 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:20,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:20,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:20,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:20,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:20,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:20,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 12:02:20,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,055 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:20,056 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:20,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:20,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:20,056 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:20,157 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:20,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:20,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:20,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:20,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,172 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:20,172 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:20,172 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:20,172 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:20,173 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,173 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,180 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:20,180 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:20,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:20,181 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:20,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,181 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:20,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,183 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,183 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 12:02:20,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:20,184 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:20,184 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:20,184 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:20,184 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:20,184 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:20,184 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:20,184 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:20,184 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:20,610 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c2e6245b8a474dc5adea714de58c9b81 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c2e6245b8a474dc5adea714de58c9b81 2023-02-13 12:02:21,016 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/ae19bdd514004b1cb96a164cac8191b7 2023-02-13 12:02:21,021 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/ae19bdd514004b1cb96a164cac8191b7 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/ae19bdd514004b1cb96a164cac8191b7 2023-02-13 12:02:21,025 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/ae19bdd514004b1cb96a164cac8191b7, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 12:02:21,026 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 842ms, sequenceid=17, compaction requested=true 2023-02-13 12:02:21,026 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:21,026 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:21,026 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:21,026 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:21,026 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,026 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:21,026 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:21,055 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,055 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:21,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:21,055 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,055 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:21,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:21,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:21,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:21,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bb9d501[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:21,056 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:21,056 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,063 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,063 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,063 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:21,063 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:21,063 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:21,063 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:21,071 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:21,071 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,071 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:21,071 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:21,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:21,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:21,073 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:21,073 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:21,073 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:21,073 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,073 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:21,080 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,080 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,080 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,080 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:21,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,081 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:21,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:21,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:21,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,088 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:21,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:21,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:21,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,189 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:21,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:21,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:21,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:21,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,196 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:21,196 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:21,196 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:21,196 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:21,197 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,197 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,223 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,223 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:21,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:21,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:21,224 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:21,224 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:21,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,226 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,226 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 12:02:21,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:21,227 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:21,227 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:21,227 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:21,227 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:21,227 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:21,227 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:21,227 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:21,227 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:21,540 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:02:21,648 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a3a46b71bf5d4e63ae6cfe7f36b9670b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3a46b71bf5d4e63ae6cfe7f36b9670b 2023-02-13 12:02:22,056 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/6c95cd90bf50489ea68facce6ed4c8ed 2023-02-13 12:02:22,067 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/6c95cd90bf50489ea68facce6ed4c8ed as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6c95cd90bf50489ea68facce6ed4c8ed 2023-02-13 12:02:22,072 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6c95cd90bf50489ea68facce6ed4c8ed, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 12:02:22,073 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 846ms, sequenceid=21, compaction requested=true 2023-02-13 12:02:22,074 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:22,074 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:22,074 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:22,074 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:22,074 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,074 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:22,074 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:22,105 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,105 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:22,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:22,106 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:22,106 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:22,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:22,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:22,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:22,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@362a4caa[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:22,111 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:22,111 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,186 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,187 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:22,187 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:22,187 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:22,187 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,187 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:22,226 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,227 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:22,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:22,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:22,227 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:22,227 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:22,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:22,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:22,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:22,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:22,238 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:22,238 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:22,238 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:22,238 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,238 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:22,252 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,253 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:22,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,252 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:22,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:22,254 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:22,257 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,269 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:22,269 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:22,269 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,269 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:22,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:22,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:22,269 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:22,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:22,270 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,270 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:22,270 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:22,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 12:02:22,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:22,270 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:22,271 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,271 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,271 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,371 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:22,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:22,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:22,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:22,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,386 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:22,387 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:22,387 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:22,387 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:22,388 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,388 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,396 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:22,397 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:22,398 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:22,398 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,400 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 12:02:22,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:22,401 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:22,401 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:22,401 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:22,401 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:22,401 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:22,401 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:22,402 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:22,402 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:22,830 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311b32099fd6994afa83c8a43b894883e4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512311b32099fd6994afa83c8a43b894883e4 2023-02-13 12:02:23,238 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/7d6710f417284dd38115001438d86983 2023-02-13 12:02:23,248 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/7d6710f417284dd38115001438d86983 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/7d6710f417284dd38115001438d86983 2023-02-13 12:02:23,254 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/7d6710f417284dd38115001438d86983, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 12:02:23,255 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 853ms, sequenceid=25, compaction requested=true 2023-02-13 12:02:23,255 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:23,255 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:23,255 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:23,255 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:23,255 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,255 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:23,255 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:23,288 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,288 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:23,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:23,289 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,289 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:23,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:23,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:23,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:23,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:23,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fe0f6e3[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:23,294 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:23,294 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,305 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,305 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:23,306 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:23,306 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:23,306 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,306 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:23,313 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,313 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:23,313 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:23,314 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:23,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:23,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:23,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:23,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:23,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:23,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:23,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:23,323 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:23,323 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:23,323 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:23,323 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,323 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:23,336 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,336 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,336 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:23,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:23,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:23,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:23,337 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:23,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:23,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,341 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:23,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,355 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,355 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:23,355 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:23,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 12:02:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:23,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:23,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:23,355 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:23,355 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,355 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:23,356 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,356 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:23,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:23,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:23,356 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:23,356 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,357 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,357 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,457 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:23,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:23,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:23,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:23,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,472 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:23,472 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:23,472 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:23,472 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:23,473 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,473 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,480 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:23,480 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:23,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:23,481 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:23,481 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:23,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:23,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,483 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,483 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 12:02:23,484 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:23,484 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:23,484 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:23,484 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:23,484 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:23,484 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:23,484 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:23,485 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:23,485 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:23,908 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013cba7ee41c3d4737ba704af833847296 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601013cba7ee41c3d4737ba704af833847296 2023-02-13 12:02:24,317 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/b5fe968e0d7f4b3ab0171a2624446f27 2023-02-13 12:02:24,329 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/b5fe968e0d7f4b3ab0171a2624446f27 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/b5fe968e0d7f4b3ab0171a2624446f27 2023-02-13 12:02:24,335 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/b5fe968e0d7f4b3ab0171a2624446f27, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 12:02:24,336 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 851ms, sequenceid=29, compaction requested=true 2023-02-13 12:02:24,336 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:24,336 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:24,336 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:24,336 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:24,336 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,336 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:24,336 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:24,363 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,363 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:24,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:24,363 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,363 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:24,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:24,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:24,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3182d0a9[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:24,366 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:24,366 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,371 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,371 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:24,371 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:24,371 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:24,371 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,371 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:24,399 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:24,399 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:24,399 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:24,399 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:24,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:24,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:24,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:24,406 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:24,406 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:24,406 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:24,406 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,406 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:24,421 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,422 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:24,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,422 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:24,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,423 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,424 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,429 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,429 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,429 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:24,430 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:24,430 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 12:02:24,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:24,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:24,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:24,430 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:24,430 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,430 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,430 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:24,430 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:24,430 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,430 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:24,531 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:24,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:24,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:24,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:24,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,548 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:24,549 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:24,549 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:24,549 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:24,550 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,550 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,560 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:24,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:24,561 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:24,561 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:24,561 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:24,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,562 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,562 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 12:02:24,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:24,562 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:24,562 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:24,562 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:24,562 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:24,562 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:24,562 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:24,562 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:24,562 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:24,983 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a0217c472c5d42479c7ae3f57c1dde10 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a0217c472c5d42479c7ae3f57c1dde10 2023-02-13 12:02:25,389 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/55e2aa8eb4e544f5beb753d19d686d3b 2023-02-13 12:02:25,400 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/55e2aa8eb4e544f5beb753d19d686d3b as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/55e2aa8eb4e544f5beb753d19d686d3b 2023-02-13 12:02:25,406 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/55e2aa8eb4e544f5beb753d19d686d3b, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 12:02:25,407 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 845ms, sequenceid=33, compaction requested=true 2023-02-13 12:02:25,407 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:25,408 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:25,408 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:25,408 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:25,408 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,408 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:25,408 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:25,438 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,438 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:25,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:25,439 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,439 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:25,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:25,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:25,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:25,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:25,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14b61a45[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:25,444 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:25,444 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,455 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,455 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:25,455 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:25,456 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:25,456 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,456 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:25,463 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:25,463 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,463 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:25,464 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:25,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:25,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:25,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:25,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:25,474 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:25,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:25,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:25,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,474 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:25,479 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,479 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,480 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:25,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:25,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:25,481 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:25,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,482 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:25,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,494 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,494 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,494 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:25,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:25,494 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:25,494 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,495 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,495 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,495 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,494 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:25,495 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:25,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:25,495 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:25,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:25,495 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:25,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:25,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:25,596 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:25,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:25,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:25,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:25,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,609 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:25,610 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:25,610 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:25,610 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:25,611 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,611 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:25,621 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:25,623 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:25,623 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,626 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,626 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 12:02:25,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:25,626 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:25,626 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:25,627 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:25,627 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:25,627 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:25,627 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:25,627 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:25,627 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:26,052 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072e8d60a2b7924fb591e045d94c1f4aad to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509072e8d60a2b7924fb591e045d94c1f4aad 2023-02-13 12:02:26,459 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/efcc4965b2a54bbf82c73ce815594999 2023-02-13 12:02:26,472 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/efcc4965b2a54bbf82c73ce815594999 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/efcc4965b2a54bbf82c73ce815594999 2023-02-13 12:02:26,479 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/efcc4965b2a54bbf82c73ce815594999, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 12:02:26,480 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 853ms, sequenceid=37, compaction requested=true 2023-02-13 12:02:26,480 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:26,480 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:26,480 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:26,480 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:26,480 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,480 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:26,480 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:26,513 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,513 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:26,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:26,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:26,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@701d4b65[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:26,519 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:26,520 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,530 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,530 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:26,530 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:26,530 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:26,530 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,531 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:26,538 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:26,538 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,538 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:26,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:26,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:26,539 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:26,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:26,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:26,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:26,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:26,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:26,549 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:26,549 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:26,549 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:26,549 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,550 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:26,561 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,561 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:26,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:26,561 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:26,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:26,562 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:26,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:26,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,565 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:26,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,602 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,602 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:26,602 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:26,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:26,603 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:26,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:26,603 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:26,603 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:26,603 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:26,604 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:26,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:26,603 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:26,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,605 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,704 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:26,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:26,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:26,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:26,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,718 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:26,718 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:26,718 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 12:02:26,718 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 12:02:26,719 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,719 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,730 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:26,730 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:26,731 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:26,731 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,733 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,733 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 12:02:26,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:26,733 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 12:02:26,734 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:26,734 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 12:02:26,734 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:26,734 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:26,734 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:26,734 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. started... 2023-02-13 12:02:26,734 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296433c6c439db3f898b5e6f399bb003 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:27,158 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e6be7d6e16144c6fae509946fc0c7250 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120e6be7d6e16144c6fae509946fc0c7250 2023-02-13 12:02:27,568 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/19af9bd9f09741f6b71fb8d10de902cb 2023-02-13 12:02:27,580 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/19af9bd9f09741f6b71fb8d10de902cb as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/19af9bd9f09741f6b71fb8d10de902cb 2023-02-13 12:02:27,586 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/19af9bd9f09741f6b71fb8d10de902cb, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 12:02:27,587 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 296433c6c439db3f898b5e6f399bb003 in 853ms, sequenceid=41, compaction requested=true 2023-02-13 12:02:27,588 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:27,588 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:27,588 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:27,588 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:27,588 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,588 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 12:02:27,588 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 12:02:27,596 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,596 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:27,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:27,597 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,597 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:27,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:27,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:27,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:27,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 12:02:27,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1822ec6b[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:27,599 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 12:02:27,599 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,605 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,605 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 12:02:27,605 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 12:02:27,605 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:27,605 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,605 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:27,613 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 12:02:27,613 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:27,613 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 12:02:27,613 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:27,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 12:02:27,621 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 12:02:27,621 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:27,621 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:27,621 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,621 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:27,629 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,630 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:27,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:27,630 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:27,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:27,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:27,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:27,631 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:27,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,634 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:27,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,646 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:27,646 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:27,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:27,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 12:02:27,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:27,646 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,647 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:27,647 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,647 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:27,647 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:27,647 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:27,647 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:27,648 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,648 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,648 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:27,748 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:27,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:27,754 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:27,758 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 12:02:27,759 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 12:02:27,761 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290347761 2023-02-13 12:02:27,761 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:27,765 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:02:27,766 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 12:02:27,766 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:27,767 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x4beb6613 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:02:27,780 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4880d936, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:02:27,780 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:28,631 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010300af22274fad4b02a887d297d33f8f36 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010300af22274fad4b02a887d297d33f8f36 2023-02-13 12:02:28,632 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:28,647 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:02:28,647 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:35528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:02:28,653 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:02:28,655 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49742, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:02:28,664 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bfdee019fe6846d68021eaee3369c126 first=Optional[r3] last=Optional[r6] 2023-02-13 12:02:28,665 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bfdee019fe6846d68021eaee3369c126}] 2023-02-13 12:02:28,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bfdee019fe6846d68021eaee3369c126 for inclusion in 296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:28,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 12:02:28,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:02:28,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:28,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bfdee019fe6846d68021eaee3369c126 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mcv3fa36q98s6392lp7ajahjic0lqiat0jmh2uav7po0pogr8kvf5mvmd1tv5d6b/family1/bfdee019fe6846d68021eaee3369c126 2023-02-13 12:02:28,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mcv3fa36q98s6392lp7ajahjic0lqiat0jmh2uav7po0pogr8kvf5mvmd1tv5d6b/family1/bfdee019fe6846d68021eaee3369c126 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/596c5d610f97448599e999b018af22ab_SeqId_44_ 2023-02-13 12:02:28,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mcv3fa36q98s6392lp7ajahjic0lqiat0jmh2uav7po0pogr8kvf5mvmd1tv5d6b/family1/bfdee019fe6846d68021eaee3369c126 into 296433c6c439db3f898b5e6f399bb003/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/596c5d610f97448599e999b018af22ab_SeqId_44_ - updating store file list. 2023-02-13 12:02:28,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/596c5d610f97448599e999b018af22ab_SeqId_44_ into 296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:28,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mcv3fa36q98s6392lp7ajahjic0lqiat0jmh2uav7po0pogr8kvf5mvmd1tv5d6b/family1/bfdee019fe6846d68021eaee3369c126 into 296433c6c439db3f898b5e6f399bb003/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/596c5d610f97448599e999b018af22ab_SeqId_44_) 2023-02-13 12:02:28,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mcv3fa36q98s6392lp7ajahjic0lqiat0jmh2uav7po0pogr8kvf5mvmd1tv5d6b/family1/bfdee019fe6846d68021eaee3369c126 2023-02-13 12:02:28,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 12:02:28,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 12:02:28,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 296433c6c439db3f898b5e6f399bb003/family1 is initiating minor compaction 2023-02-13 12:02:28,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@119fe511; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:28,682 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 296433c6c439db3f898b5e6f399bb003/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:28,682 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/4dfac0fb2f7e4287873cdbd7d3cf4cb0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f5f1697989af4d1482e4b2c3632a6826, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/ae19bdd514004b1cb96a164cac8191b7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6c95cd90bf50489ea68facce6ed4c8ed, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/7d6710f417284dd38115001438d86983, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/b5fe968e0d7f4b3ab0171a2624446f27, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/55e2aa8eb4e544f5beb753d19d686d3b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/efcc4965b2a54bbf82c73ce815594999, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/19af9bd9f09741f6b71fb8d10de902cb, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/596c5d610f97448599e999b018af22ab_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp, totalSize=50.4 K 2023-02-13 12:02:28,682 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 4dfac0fb2f7e4287873cdbd7d3cf4cb0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 12:02:28,682 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting f5f1697989af4d1482e4b2c3632a6826, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 12:02:28,682 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting ae19bdd514004b1cb96a164cac8191b7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 12:02:28,682 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 6c95cd90bf50489ea68facce6ed4c8ed, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 12:02:28,683 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 7d6710f417284dd38115001438d86983, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 12:02:28,683 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting b5fe968e0d7f4b3ab0171a2624446f27, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 12:02:28,683 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 55e2aa8eb4e544f5beb753d19d686d3b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 12:02:28,683 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting efcc4965b2a54bbf82c73ce815594999, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 12:02:28,683 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 19af9bd9f09741f6b71fb8d10de902cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 12:02:28,683 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 596c5d610f97448599e999b018af22ab_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 12:02:28,685 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:28,685 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:28,687 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3a46b71bf5d4e63ae6cfe7f36b9670b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3a46b71bf5d4e63ae6cfe7f36b9670b 2023-02-13 12:02:28,689 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512311b32099fd6994afa83c8a43b894883e4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512311b32099fd6994afa83c8a43b894883e4 2023-02-13 12:02:28,690 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601013cba7ee41c3d4737ba704af833847296 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601013cba7ee41c3d4737ba704af833847296 2023-02-13 12:02:28,691 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a0217c472c5d42479c7ae3f57c1dde10 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a0217c472c5d42479c7ae3f57c1dde10 2023-02-13 12:02:28,691 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-13 12:02:28,691 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 12:02:28,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:28,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:28,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:28,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:28,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:28,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:28,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:28,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:28,714 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): 296433c6c439db3f898b5e6f399bb003#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:02:29,139 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/13bfeb45fb0a4a87bf5c34db6197f5fe as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/13bfeb45fb0a4a87bf5c34db6197f5fe 2023-02-13 12:02:29,145 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 296433c6c439db3f898b5e6f399bb003/family1 of 296433c6c439db3f898b5e6f399bb003 into 13bfeb45fb0a4a87bf5c34db6197f5fe(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:02:29,145 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:29,145 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676289748682; duration=0sec 2023-02-13 12:02:29,145 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:29,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/4dfac0fb2f7e4287873cdbd7d3cf4cb0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f5f1697989af4d1482e4b2c3632a6826, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/ae19bdd514004b1cb96a164cac8191b7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6c95cd90bf50489ea68facce6ed4c8ed, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/7d6710f417284dd38115001438d86983, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/b5fe968e0d7f4b3ab0171a2624446f27, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/55e2aa8eb4e544f5beb753d19d686d3b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/efcc4965b2a54bbf82c73ce815594999, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/19af9bd9f09741f6b71fb8d10de902cb, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/596c5d610f97448599e999b018af22ab_SeqId_44_] to archive 2023-02-13 12:02:29,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:29,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/4dfac0fb2f7e4287873cdbd7d3cf4cb0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/4dfac0fb2f7e4287873cdbd7d3cf4cb0 2023-02-13 12:02:29,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f5f1697989af4d1482e4b2c3632a6826 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f5f1697989af4d1482e4b2c3632a6826 2023-02-13 12:02:29,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/ae19bdd514004b1cb96a164cac8191b7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/ae19bdd514004b1cb96a164cac8191b7 2023-02-13 12:02:29,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6c95cd90bf50489ea68facce6ed4c8ed to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6c95cd90bf50489ea68facce6ed4c8ed 2023-02-13 12:02:29,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/7d6710f417284dd38115001438d86983 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/7d6710f417284dd38115001438d86983 2023-02-13 12:02:29,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/b5fe968e0d7f4b3ab0171a2624446f27 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/b5fe968e0d7f4b3ab0171a2624446f27 2023-02-13 12:02:29,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/55e2aa8eb4e544f5beb753d19d686d3b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/55e2aa8eb4e544f5beb753d19d686d3b 2023-02-13 12:02:29,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/efcc4965b2a54bbf82c73ce815594999 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/efcc4965b2a54bbf82c73ce815594999 2023-02-13 12:02:29,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/19af9bd9f09741f6b71fb8d10de902cb to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/19af9bd9f09741f6b71fb8d10de902cb 2023-02-13 12:02:29,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/596c5d610f97448599e999b018af22ab_SeqId_44_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/596c5d610f97448599e999b018af22ab_SeqId_44_ 2023-02-13 12:02:29,546 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120523f15f46055246a6bd4913420326a819 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120523f15f46055246a6bd4913420326a819 2023-02-13 12:02:29,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:29,572 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/df84166e6ea948db92844ce831928326 first=Optional[r00] last=Optional[r2] 2023-02-13 12:02:29,572 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/df84166e6ea948db92844ce831928326}] 2023-02-13 12:02:29,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/df84166e6ea948db92844ce831928326 for inclusion in 296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:29,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 12:02:29,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:02:29,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:29,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/df84166e6ea948db92844ce831928326 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6hv284nteaip853f9ji1bmuiu40hfi2bd0nl0c7ec64h26q4qn1bfpb9nkjus08/family1/df84166e6ea948db92844ce831928326 2023-02-13 12:02:29,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6hv284nteaip853f9ji1bmuiu40hfi2bd0nl0c7ec64h26q4qn1bfpb9nkjus08/family1/df84166e6ea948db92844ce831928326 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/518cdf7722724b7aa50bf10b37f7e489_SeqId_47_ 2023-02-13 12:02:29,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6hv284nteaip853f9ji1bmuiu40hfi2bd0nl0c7ec64h26q4qn1bfpb9nkjus08/family1/df84166e6ea948db92844ce831928326 into 296433c6c439db3f898b5e6f399bb003/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/518cdf7722724b7aa50bf10b37f7e489_SeqId_47_ - updating store file list. 2023-02-13 12:02:29,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/518cdf7722724b7aa50bf10b37f7e489_SeqId_47_ into 296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:29,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6hv284nteaip853f9ji1bmuiu40hfi2bd0nl0c7ec64h26q4qn1bfpb9nkjus08/family1/df84166e6ea948db92844ce831928326 into 296433c6c439db3f898b5e6f399bb003/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/518cdf7722724b7aa50bf10b37f7e489_SeqId_47_) 2023-02-13 12:02:29,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6hv284nteaip853f9ji1bmuiu40hfi2bd0nl0c7ec64h26q4qn1bfpb9nkjus08/family1/df84166e6ea948db92844ce831928326 2023-02-13 12:02:29,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 12:02:29,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 12:02:29,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 296433c6c439db3f898b5e6f399bb003/family1 is initiating minor compaction (all files) 2023-02-13 12:02:29,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@68450e08; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:29,589 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 296433c6c439db3f898b5e6f399bb003/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:29,589 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6e7073f85e9b490cb1d8ed8b34f141cf, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/13bfeb45fb0a4a87bf5c34db6197f5fe, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/518cdf7722724b7aa50bf10b37f7e489_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp, totalSize=390.1 K 2023-02-13 12:02:29,590 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 6e7073f85e9b490cb1d8ed8b34f141cf, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807319 2023-02-13 12:02:29,590 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 13bfeb45fb0a4a87bf5c34db6197f5fe, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207319 2023-02-13 12:02:29,590 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 518cdf7722724b7aa50bf10b37f7e489_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878807319 2023-02-13 12:02:29,591 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:29,591 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:29,593 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130363cec0fc74343eebec98799815b7d12 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130363cec0fc74343eebec98799815b7d12 2023-02-13 12:02:29,594 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201a74afd76003441038ffb876c73371920 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201a74afd76003441038ffb876c73371920 2023-02-13 12:02:29,595 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c2e6245b8a474dc5adea714de58c9b81 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c2e6245b8a474dc5adea714de58c9b81 2023-02-13 12:02:29,595 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-13 12:02:29,595 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 12:02:29,596 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:29,596 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:29,596 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:29,597 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 12:02:29,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8410 sec 2023-02-13 12:02:29,604 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): 296433c6c439db3f898b5e6f399bb003#family1#compaction#62 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:02:29,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 12:02:29,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:30,084 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 12:02:30,087 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 12:02:30,088 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 12:02:30,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 12:02:30,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, REOPEN/MOVE}] 2023-02-13 12:02:30,099 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, REOPEN/MOVE 2023-02-13 12:02:30,100 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:30,101 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289750100"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289750100"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289750100"}]},"ts":"1676289750100"} 2023-02-13 12:02:30,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:30,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:30,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 296433c6c439db3f898b5e6f399bb003, disabling compactions & flushes 2023-02-13 12:02:30,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:30,846 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/.tmp/family1/bd695551de4b442eb828ab191aa5e0dc as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/bd695551de4b442eb828ab191aa5e0dc 2023-02-13 12:02:30,852 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 296433c6c439db3f898b5e6f399bb003/family1 of 296433c6c439db3f898b5e6f399bb003 into bd695551de4b442eb828ab191aa5e0dc(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:02:30,852 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:30,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:30,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:30,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. after waiting 0 ms 2023-02-13 12:02:30,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:30,853 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1676289749589; duration=1sec 2023-02-13 12:02:30,853 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:30,855 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6e7073f85e9b490cb1d8ed8b34f141cf, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/13bfeb45fb0a4a87bf5c34db6197f5fe, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/518cdf7722724b7aa50bf10b37f7e489_SeqId_47_] to archive 2023-02-13 12:02:30,855 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:30,858 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6e7073f85e9b490cb1d8ed8b34f141cf to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/6e7073f85e9b490cb1d8ed8b34f141cf 2023-02-13 12:02:30,859 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/13bfeb45fb0a4a87bf5c34db6197f5fe to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/13bfeb45fb0a4a87bf5c34db6197f5fe 2023-02-13 12:02:30,860 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/518cdf7722724b7aa50bf10b37f7e489_SeqId_47_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/518cdf7722724b7aa50bf10b37f7e489_SeqId_47_ 2023-02-13 12:02:30,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 12:02:30,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:30,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 296433c6c439db3f898b5e6f399bb003: Waiting for close lock at 1676289750255Running coprocessor pre-close hooks at 1676289750255Disabling compacts and flushes for region at 1676289750255Disabling writes for close at 1676289750853 (+598 ms)Writing region close event to WAL at 1676289750863 (+10 ms)Running coprocessor post-close hooks at 1676289750866 (+3 ms)Closed at 1676289750866 2023-02-13 12:02:30,867 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 296433c6c439db3f898b5e6f399bb003 to self. 2023-02-13 12:02:30,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:30,869 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=CLOSED 2023-02-13 12:02:30,869 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289750868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289750868"}]},"ts":"1676289750868"} 2023-02-13 12:02:30,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-13 12:02:30,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697 in 768 msec 2023-02-13 12:02:30,873 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=true 2023-02-13 12:02:31,023 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:31,024 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289751023"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289751023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289751023"}]},"ts":"1676289751023"} 2023-02-13 12:02:31,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:31,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:31,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 296433c6c439db3f898b5e6f399bb003, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:02:31,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:31,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:31,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:31,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:31,186 INFO [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:31,187 DEBUG [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:31,187 DEBUG [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:31,188 INFO [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 296433c6c439db3f898b5e6f399bb003 columnFamilyName family1 2023-02-13 12:02:31,196 DEBUG [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/bd695551de4b442eb828ab191aa5e0dc 2023-02-13 12:02:31,196 INFO [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] regionserver.HStore(310): Store=296433c6c439db3f898b5e6f399bb003/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:31,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:31,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:31,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:31,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 296433c6c439db3f898b5e6f399bb003; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69133213, jitterRate=0.03016515076160431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:02:31,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 296433c6c439db3f898b5e6f399bb003: Running coprocessor pre-open hook at 1676289751184Writing region info on filesystem at 1676289751184Initializing all the Stores at 1676289751186 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676289751186Cleaning up temporary data from old regions at 1676289751200 (+14 ms)Cleaning up detritus from prior splits at 1676289751200Running coprocessor post-open hooks at 1676289751204 (+4 ms)Region opened successfully at 1676289751204 2023-02-13 12:02:31,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003., pid=47, masterSystemTime=1676289751180 2023-02-13 12:02:31,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:31,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:31,207 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:31,208 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289751207"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289751207"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289751207"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289751207"}]},"ts":"1676289751207"} 2023-02-13 12:02:31,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-13 12:02:31,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697 in 182 msec 2023-02-13 12:02:31,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-13 12:02:31,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, REOPEN/MOVE in 1.1130 sec 2023-02-13 12:02:31,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-13 12:02:31,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1190 sec 2023-02-13 12:02:31,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5430 sec 2023-02-13 12:02:31,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-13 12:02:31,217 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(278): alter status finished 2023-02-13 12:02:31,218 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:31,219 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 12:02:31,220 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 12:02:31,221 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:31,221 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290351221 2023-02-13 12:02:31,221 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:02:31,222 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 12:02:31,222 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:31,222 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x41fa756c to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:02:31,297 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f7d5d0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:02:31,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:31,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:31,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:31,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:31,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:32,160 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128035d89bc795344039988896b583397ba to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128035d89bc795344039988896b583397ba 2023-02-13 12:02:32,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:32,176 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:02:32,177 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:02:32,183 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:02:32,185 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:02:32,193 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fcb1db0ac9d745d5888b69f2833b6f49 first=Optional[r05] last=Optional[r8] 2023-02-13 12:02:32,193 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fcb1db0ac9d745d5888b69f2833b6f49}] 2023-02-13 12:02:32,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fcb1db0ac9d745d5888b69f2833b6f49 for inclusion in 296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:32,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 12:02:32,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:02:32,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 296433c6c439db3f898b5e6f399bb003: 2023-02-13 12:02:32,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fcb1db0ac9d745d5888b69f2833b6f49 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9nslpciveset2b2tmp762ttigkqvrmnt3iduoba7j373i05ij2p6hp8831s70dfa/family1/fcb1db0ac9d745d5888b69f2833b6f49 2023-02-13 12:02:32,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9nslpciveset2b2tmp762ttigkqvrmnt3iduoba7j373i05ij2p6hp8831s70dfa/family1/fcb1db0ac9d745d5888b69f2833b6f49 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f68d13cbee644bb0bc411cde6a3fa300_SeqId_53_ 2023-02-13 12:02:32,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9nslpciveset2b2tmp762ttigkqvrmnt3iduoba7j373i05ij2p6hp8831s70dfa/family1/fcb1db0ac9d745d5888b69f2833b6f49 into 296433c6c439db3f898b5e6f399bb003/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f68d13cbee644bb0bc411cde6a3fa300_SeqId_53_ - updating store file list. 2023-02-13 12:02:32,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f68d13cbee644bb0bc411cde6a3fa300_SeqId_53_ into 296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:32,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9nslpciveset2b2tmp762ttigkqvrmnt3iduoba7j373i05ij2p6hp8831s70dfa/family1/fcb1db0ac9d745d5888b69f2833b6f49 into 296433c6c439db3f898b5e6f399bb003/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f68d13cbee644bb0bc411cde6a3fa300_SeqId_53_) 2023-02-13 12:02:32,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9nslpciveset2b2tmp762ttigkqvrmnt3iduoba7j373i05ij2p6hp8831s70dfa/family1/fcb1db0ac9d745d5888b69f2833b6f49 2023-02-13 12:02:32,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:32,212 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:32,213 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120e6be7d6e16144c6fae509946fc0c7250 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120e6be7d6e16144c6fae509946fc0c7250 2023-02-13 12:02:32,214 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511280763cd5f2dfb4460a01c9823eada485b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511280763cd5f2dfb4460a01c9823eada485b 2023-02-13 12:02:32,214 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-13 12:02:32,214 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 12:02:32,214 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:32,214 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:32,215 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:32,215 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:32,215 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:32,216 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 12:02:32,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 998 msec 2023-02-13 12:02:32,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 12:02:32,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:32,686 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 12:02:32,690 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 12:02:32,690 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 12:02:32,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 12:02:32,699 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, REOPEN/MOVE}] 2023-02-13 12:02:32,700 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, REOPEN/MOVE 2023-02-13 12:02:32,701 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:32,701 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289752701"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289752701"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289752701"}]},"ts":"1676289752701"} 2023-02-13 12:02:32,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:32,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:32,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 296433c6c439db3f898b5e6f399bb003, disabling compactions & flushes 2023-02-13 12:02:32,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:32,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:32,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. after waiting 0 ms 2023-02-13 12:02:32,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:32,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 12:02:32,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:32,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 296433c6c439db3f898b5e6f399bb003: Waiting for close lock at 1676289752856Running coprocessor pre-close hooks at 1676289752856Disabling compacts and flushes for region at 1676289752856Disabling writes for close at 1676289752856Writing region close event to WAL at 1676289752862 (+6 ms)Running coprocessor post-close hooks at 1676289752868 (+6 ms)Closed at 1676289752869 (+1 ms) 2023-02-13 12:02:32,869 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 296433c6c439db3f898b5e6f399bb003 to self. 2023-02-13 12:02:32,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:32,871 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=CLOSED 2023-02-13 12:02:32,871 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289752871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289752871"}]},"ts":"1676289752871"} 2023-02-13 12:02:32,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-13 12:02:32,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697 in 170 msec 2023-02-13 12:02:32,875 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=true 2023-02-13 12:02:33,025 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:33,026 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289753025"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289753025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289753025"}]},"ts":"1676289753025"} 2023-02-13 12:02:33,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:33,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:33,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 296433c6c439db3f898b5e6f399bb003, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:02:33,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:33,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:33,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:33,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:33,192 INFO [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:33,194 DEBUG [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:33,194 DEBUG [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1 2023-02-13 12:02:33,195 INFO [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 296433c6c439db3f898b5e6f399bb003 columnFamilyName family1 2023-02-13 12:02:33,203 DEBUG [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/bd695551de4b442eb828ab191aa5e0dc 2023-02-13 12:02:33,207 DEBUG [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/family1/f68d13cbee644bb0bc411cde6a3fa300_SeqId_53_ 2023-02-13 12:02:33,207 INFO [StoreOpener-296433c6c439db3f898b5e6f399bb003-1] regionserver.HStore(310): Store=296433c6c439db3f898b5e6f399bb003/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:33,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:33,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:33,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:02:33,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 296433c6c439db3f898b5e6f399bb003; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59403677, jitterRate=-0.11481623351573944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:02:33,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 296433c6c439db3f898b5e6f399bb003: Running coprocessor pre-open hook at 1676289753190Writing region info on filesystem at 1676289753190Initializing all the Stores at 1676289753192 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676289753192Cleaning up temporary data from old regions at 1676289753210 (+18 ms)Cleaning up detritus from prior splits at 1676289753211 (+1 ms)Running coprocessor post-open hooks at 1676289753214 (+3 ms)Region opened successfully at 1676289753214 2023-02-13 12:02:33,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003., pid=53, masterSystemTime=1676289753183 2023-02-13 12:02:33,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:33,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:02:33,217 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=296433c6c439db3f898b5e6f399bb003, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:33,217 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676289753217"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289753217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289753217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289753217"}]},"ts":"1676289753217"} 2023-02-13 12:02:33,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-13 12:02:33,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 296433c6c439db3f898b5e6f399bb003, server=jenkins-hbase16.apache.org,39857,1676289663697 in 190 msec 2023-02-13 12:02:33,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-13 12:02:33,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=296433c6c439db3f898b5e6f399bb003, REOPEN/MOVE in 521 msec 2023-02-13 12:02:33,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-13 12:02:33,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 526 msec 2023-02-13 12:02:33,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 951 msec 2023-02-13 12:02:33,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-13 12:02:33,227 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(278): alter status finished 2023-02-13 12:02:33,228 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 12:02:33,230 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 12:02:33,230 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 12:02:33,231 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:33,231 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290353231 2023-02-13 12:02:33,232 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:02:33,232 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 12:02:33,232 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:33,233 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x7c53d9b0 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:02:33,263 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19a36e0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:02:33,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:33,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:33,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:33,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:33,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:33,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:33,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:33,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 12:02:33,264 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 12:02:33,264 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:33,265 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 12:02:33,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 36 msec 2023-02-13 12:02:33,327 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=243 (was 245), OpenFileDescriptor=615 (was 592) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=107 (was 138), ProcessCount=165 (was 165), AvailableMemoryMB=6088 (was 6095) 2023-02-13 12:02:33,338 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=107, ProcessCount=165, AvailableMemoryMB=6088 2023-02-13 12:02:33,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 12:02:33,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:33,343 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:02:33,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-13 12:02:33,343 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:02:33,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 12:02:33,345 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:33,345 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41 empty. 2023-02-13 12:02:33,346 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:33,346 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-13 12:02:33,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 12:02:33,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 12:02:33,758 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 12:02:33,761 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 58ec3f3b39089ccb03970dd0c83adb41, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:02:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 12:02:34,172 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:34,172 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 58ec3f3b39089ccb03970dd0c83adb41, disabling compactions & flushes 2023-02-13 12:02:34,173 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:34,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:34,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. after waiting 0 ms 2023-02-13 12:02:34,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:34,173 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:34,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 58ec3f3b39089ccb03970dd0c83adb41: Waiting for close lock at 1676289754172Disabling compacts and flushes for region at 1676289754172Disabling writes for close at 1676289754173 (+1 ms)Writing region close event to WAL at 1676289754173Closed at 1676289754173 2023-02-13 12:02:34,178 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:02:34,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289754180"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289754180"}]},"ts":"1676289754180"} 2023-02-13 12:02:34,183 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 12:02:34,185 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:02:34,185 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289754185"}]},"ts":"1676289754185"} 2023-02-13 12:02:34,187 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-13 12:02:34,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, ASSIGN}] 2023-02-13 12:02:34,232 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, ASSIGN 2023-02-13 12:02:34,233 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:02:34,385 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:34,385 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289754385"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289754385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289754385"}]},"ts":"1676289754385"} 2023-02-13 12:02:34,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:34,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 12:02:34,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:34,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 58ec3f3b39089ccb03970dd0c83adb41, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:02:34,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:34,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:34,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:34,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:34,546 INFO [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:34,548 DEBUG [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:34,548 DEBUG [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:34,548 INFO [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58ec3f3b39089ccb03970dd0c83adb41 columnFamilyName family1 2023-02-13 12:02:34,549 INFO [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] regionserver.HStore(310): Store=58ec3f3b39089ccb03970dd0c83adb41/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:34,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:34,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:34,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:34,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:02:34,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 58ec3f3b39089ccb03970dd0c83adb41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66445859, jitterRate=-0.009879544377326965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:02:34,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 58ec3f3b39089ccb03970dd0c83adb41: Running coprocessor pre-open hook at 1676289754545Writing region info on filesystem at 1676289754545Initializing all the Stores at 1676289754546 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676289754546Cleaning up temporary data from old regions at 1676289754551 (+5 ms)Cleaning up detritus from prior splits at 1676289754551Running coprocessor post-open hooks at 1676289754556 (+5 ms)Region opened successfully at 1676289754556 2023-02-13 12:02:34,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41., pid=57, masterSystemTime=1676289754541 2023-02-13 12:02:34,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:34,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:34,558 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:34,558 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289754558"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289754558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289754558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289754558"}]},"ts":"1676289754558"} 2023-02-13 12:02:34,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-13 12:02:34,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697 in 171 msec 2023-02-13 12:02:34,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-13 12:02:34,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, ASSIGN in 332 msec 2023-02-13 12:02:34,563 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:02:34,563 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289754563"}]},"ts":"1676289754563"} 2023-02-13 12:02:34,564 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-13 12:02:34,597 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:02:34,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.2570 sec 2023-02-13 12:02:35,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 12:02:35,456 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-13 12:02:35,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:35,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:35,485 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:35,485 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:35,485 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:35,485 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:35,485 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:35,485 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:35,508 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:35,512 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:35,512 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:35,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:35,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:35,513 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:35,513 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:35,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:35,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:35,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:35,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:35,514 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:35,514 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:35,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:35,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:35,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:35,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:35,514 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:35,514 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:35,514 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:35,515 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 12:02:35,930 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306d153a7b6dc84f25bd3e2e10ee34431a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511306d153a7b6dc84f25bd3e2e10ee34431a 2023-02-13 12:02:36,335 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/82aa1f9cb48a411ba63b6cfec6d412b2 2023-02-13 12:02:36,345 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/82aa1f9cb48a411ba63b6cfec6d412b2 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/82aa1f9cb48a411ba63b6cfec6d412b2 2023-02-13 12:02:36,351 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/82aa1f9cb48a411ba63b6cfec6d412b2, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-13 12:02:36,352 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 837ms, sequenceid=5, compaction requested=false 2023-02-13 12:02:36,352 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:36,352 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:36,352 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:36,352 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:36,353 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,353 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:36,353 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:36,396 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,396 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:36,396 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:02:36,397 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,397 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:36,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:36,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:36,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:36,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:36,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f02605e[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:36,402 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:36,402 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,412 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,413 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:36,413 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:36,413 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,413 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:36,413 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:36,436 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:36,436 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,436 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:36,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:36,436 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c53d9b0 to 127.0.0.1:62284 2023-02-13 12:02:36,436 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:36,437 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:02:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:36,437 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:02:36,437 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41fa756c to 127.0.0.1:62284 2023-02-13 12:02:36,437 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:02:36,437 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:02:36,437 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4beb6613 to 127.0.0.1:62284 2023-02-13 12:02:36,437 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:02:36,437 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:02:36,438 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ef1e9aa to 127.0.0.1:62284 2023-02-13 12:02:36,438 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:02:36,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:36,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:36,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:36,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:36,456 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:36,456 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:36,456 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:36,456 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,456 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:36,462 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,462 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,462 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:36,463 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,464 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:36,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:36,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 12:02:36,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:36,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,493 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:36,493 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:36,594 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:36,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:36,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:36,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:36,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,601 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:36,601 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:36,601 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:36,601 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:36,602 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,602 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,612 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:36,612 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:36,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:36,613 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:36,613 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:36,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:36,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,615 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,615 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 12:02:36,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:36,615 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:36,615 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:36,616 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:36,616 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:36,616 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:36,616 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:36,616 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:36,616 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 12:02:37,035 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128677640c54c154902b498670c939823f1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128677640c54c154902b498670c939823f1 2023-02-13 12:02:37,440 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/34ea7d573fdb42a09464e70bd9280932 2023-02-13 12:02:37,450 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/34ea7d573fdb42a09464e70bd9280932 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/34ea7d573fdb42a09464e70bd9280932 2023-02-13 12:02:37,458 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/34ea7d573fdb42a09464e70bd9280932, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 12:02:37,459 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 843ms, sequenceid=9, compaction requested=false 2023-02-13 12:02:37,459 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:37,459 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:37,459 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:37,460 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:37,460 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,460 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:37,460 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:37,557 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,557 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:37,558 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:37,558 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:37,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:37,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bc221c9[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:37,564 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:37,565 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,579 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,580 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:37,580 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:37,580 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:37,581 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,581 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:37,587 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:37,587 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,588 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:37,588 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:37,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:37,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:37,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:37,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:37,594 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:37,594 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:37,594 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:37,594 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,594 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:37,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:37,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:37,606 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:37,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,609 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:37,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,621 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:37,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:37,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:37,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:37,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:37,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:37,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:37,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 12:02:37,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,621 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,622 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:37,622 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:37,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:37,722 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:37,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:37,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:37,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:37,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,730 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:37,730 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:37,731 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:37,731 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:37,731 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,731 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,737 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,737 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:37,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:37,738 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:37,738 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,740 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,740 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 12:02:37,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:37,740 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:37,740 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:37,740 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:37,741 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:37,741 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:37,741 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:37,741 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:37,741 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:38,168 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ee48f8d565cf405baa888c148454a1bf to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201ee48f8d565cf405baa888c148454a1bf 2023-02-13 12:02:38,577 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/c094d81e6b9a422fb9998dbb87761053 2023-02-13 12:02:38,590 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/c094d81e6b9a422fb9998dbb87761053 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c094d81e6b9a422fb9998dbb87761053 2023-02-13 12:02:38,595 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c094d81e6b9a422fb9998dbb87761053, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 12:02:38,596 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 855ms, sequenceid=13, compaction requested=true 2023-02-13 12:02:38,596 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:38,596 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:38,596 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:38,596 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:38,596 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,596 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:38,596 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:38,629 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,629 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:38,630 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,630 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:38,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:38,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e07b7[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:38,632 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:38,632 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,637 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,638 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:38,638 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:38,638 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:38,638 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,638 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:38,646 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:38,646 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,646 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:38,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:38,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:38,646 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:38,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:38,651 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:38,651 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:38,651 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:38,651 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,651 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:38,662 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,663 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:38,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,662 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:38,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:38,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:38,664 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:38,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,667 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:38,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,679 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,679 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,679 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,679 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 12:02:38,679 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:38,679 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:38,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:38,679 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:38,679 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:38,679 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:38,680 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:38,680 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:38,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:38,679 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:38,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:38,780 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:38,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:38,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:38,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:38,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,787 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:38,787 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:38,787 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:38,787 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:38,788 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,788 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,818 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,819 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:38,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:38,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:38,819 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:38,819 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,822 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,822 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 12:02:38,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:38,822 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:38,822 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:38,822 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:38,823 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:38,823 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:38,823 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:38,823 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:38,823 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:39,246 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052fceada9149e48479004a37cf35cdf43 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052fceada9149e48479004a37cf35cdf43 2023-02-13 12:02:39,655 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/84405ecccc204698becb591ec1c9c145 2023-02-13 12:02:39,669 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/84405ecccc204698becb591ec1c9c145 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/84405ecccc204698becb591ec1c9c145 2023-02-13 12:02:39,675 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/84405ecccc204698becb591ec1c9c145, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 12:02:39,675 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 852ms, sequenceid=17, compaction requested=true 2023-02-13 12:02:39,676 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:39,676 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:39,676 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:39,676 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:39,676 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,676 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:39,676 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:39,704 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,704 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:39,704 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,704 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:39,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:39,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e50f25b[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:39,708 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:39,708 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,718 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,719 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:39,719 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:39,719 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:39,719 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,719 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:39,729 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:39,729 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,729 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:39,730 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:39,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:39,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:39,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:39,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:39,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:39,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:39,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:39,738 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:39,738 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:39,738 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:39,738 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,738 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:39,746 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,746 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:39,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,746 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:39,746 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,748 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:39,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:39,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:39,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:39,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:39,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 12:02:39,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:39,754 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:39,754 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:39,755 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:39,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,755 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,755 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,755 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:39,755 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:39,855 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:39,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:39,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:39,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:39,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,870 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:39,871 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:39,871 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:39,871 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:39,872 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,872 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,879 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:39,879 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:39,879 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:39,879 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,880 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,880 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 12:02:39,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:39,880 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:39,880 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:39,880 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:39,881 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:39,881 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:39,881 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:39,881 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:39,881 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:40,308 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228da400f7dd22844399d4ed7343d73d4d8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228da400f7dd22844399d4ed7343d73d4d8 2023-02-13 12:02:40,716 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/c369a8d992c5493fb3eb18fecf917c7e 2023-02-13 12:02:40,728 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/c369a8d992c5493fb3eb18fecf917c7e as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c369a8d992c5493fb3eb18fecf917c7e 2023-02-13 12:02:40,733 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c369a8d992c5493fb3eb18fecf917c7e, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 12:02:40,733 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 852ms, sequenceid=21, compaction requested=true 2023-02-13 12:02:40,734 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:40,734 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:40,734 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:40,734 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:40,734 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,734 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:40,734 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:40,762 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,762 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:40,763 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,764 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:40,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:40,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22fc735f[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:40,768 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:40,768 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,779 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,780 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:40,780 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:40,780 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:40,780 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,780 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:40,787 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:40,788 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:40,788 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:40,788 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:40,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:40,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:40,797 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:40,797 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:40,797 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:40,797 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,797 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:40,804 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,804 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,804 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:40,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:40,805 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,807 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,818 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,818 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,818 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,818 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,818 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,818 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:40,818 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:40,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 12:02:40,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:40,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:40,818 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,819 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:40,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:40,819 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:40,819 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:40,819 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:40,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:40,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:40,919 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:40,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:40,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:40,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:40,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,928 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:40,928 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:40,928 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:40,928 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:40,929 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,929 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,937 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:40,937 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:40,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:40,937 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:40,938 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:40,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:40,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,938 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,938 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 12:02:40,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:40,938 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:40,938 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:40,939 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:40,939 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:40,939 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:40,939 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:40,939 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:40,939 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:41,360 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b041eccaa7d8493aad2c35b15c23365f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b041eccaa7d8493aad2c35b15c23365f 2023-02-13 12:02:41,766 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/c3c5955ee2344adaaa750c7e983e1832 2023-02-13 12:02:41,773 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/c3c5955ee2344adaaa750c7e983e1832 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c3c5955ee2344adaaa750c7e983e1832 2023-02-13 12:02:41,779 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c3c5955ee2344adaaa750c7e983e1832, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 12:02:41,780 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 841ms, sequenceid=25, compaction requested=true 2023-02-13 12:02:41,780 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:41,780 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:41,781 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:41,781 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:41,781 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,781 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:41,781 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:41,820 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,820 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:41,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:41,821 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,821 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:41,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:41,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:41,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:41,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:41,822 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:41,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@283ad2a0[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:41,822 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,829 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,829 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:41,829 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:41,829 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,829 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:41,829 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:41,856 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:41,856 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:41,856 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:41,856 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:41,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:41,858 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:41,858 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:41,858 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:41,858 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,858 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:41,898 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,898 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:41,898 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,898 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:41,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,899 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,912 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:41,912 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:41,912 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:41,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 12:02:41,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:41,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:41,912 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,912 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:41,913 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,913 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:41,913 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,913 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:41,913 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:41,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:41,913 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:41,913 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,013 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:42,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:42,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:42,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:42,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,020 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:42,020 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:42,020 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:42,020 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:42,020 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,020 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,029 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:42,029 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:42,029 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,029 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:42,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,030 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,030 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 12:02:42,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,030 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:42,030 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:42,030 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:42,030 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:42,030 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:42,030 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:42,031 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:42,031 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:42,449 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c7023d67b95e4580b64522ea9d97aa54 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101c7023d67b95e4580b64522ea9d97aa54 2023-02-13 12:02:42,857 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/59b45eb45538494c95ae5b7b7c8b51d3 2023-02-13 12:02:42,869 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/59b45eb45538494c95ae5b7b7c8b51d3 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/59b45eb45538494c95ae5b7b7c8b51d3 2023-02-13 12:02:42,875 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/59b45eb45538494c95ae5b7b7c8b51d3, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 12:02:42,877 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 846ms, sequenceid=29, compaction requested=true 2023-02-13 12:02:42,877 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:42,877 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:42,877 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:42,877 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:42,877 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,877 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:42,877 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:42,887 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,887 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:42,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:42,887 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,888 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:42,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:42,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:42,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:42,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:42,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5968cbaf[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:42,891 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:42,891 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,902 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,902 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:42,902 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:42,902 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:42,902 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,902 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:42,912 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:42,913 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:42,912 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,913 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:42,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:42,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:42,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:42,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:42,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:42,921 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:42,921 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:42,921 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:42,921 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,921 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:42,929 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,929 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,929 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:42,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:42,930 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,932 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,943 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,943 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:42,943 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:42,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:42,944 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,944 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:42,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:42,944 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:42,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 12:02:42,944 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:42,945 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:42,944 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:42,945 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:42,945 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:42,945 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,045 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:43,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:43,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:43,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:43,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,062 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:43,062 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:43,062 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:43,062 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:43,063 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,063 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,071 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:43,071 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:43,071 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,071 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,072 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,072 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 12:02:43,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,072 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:43,072 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:43,073 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:43,073 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:43,073 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:43,073 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:43,073 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:43,073 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:43,492 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103671b2f5eef5e4dd793e3afcf74038de5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103671b2f5eef5e4dd793e3afcf74038de5 2023-02-13 12:02:43,900 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/92970a3de984457bb2ceb4a52e800fa8 2023-02-13 12:02:43,910 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/92970a3de984457bb2ceb4a52e800fa8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/92970a3de984457bb2ceb4a52e800fa8 2023-02-13 12:02:43,915 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/92970a3de984457bb2ceb4a52e800fa8, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 12:02:43,915 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 842ms, sequenceid=33, compaction requested=true 2023-02-13 12:02:43,916 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:43,916 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:43,916 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:43,916 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:43,916 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,916 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:43,916 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:43,945 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,945 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:43,946 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,946 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:43,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:43,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:43,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50a338f3[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:43,947 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:43,947 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,954 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,954 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:43,954 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:43,954 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:43,954 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,954 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:43,962 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,962 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:43,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:43,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:43,962 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:43,962 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:43,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:43,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:43,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:43,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:43,965 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:43,965 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:43,965 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:43,965 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,965 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:43,970 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,970 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:43,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,970 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:43,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:43,971 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,972 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,979 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:43,979 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:43,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:43,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:43,979 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,979 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:43,979 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 12:02:43,979 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:43,979 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:43,979 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:43,979 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:43,980 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,980 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,980 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:43,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:44,080 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:44,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:44,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:44,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:44,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,095 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:44,095 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:44,095 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:44,095 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:44,096 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,096 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,104 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:44,104 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:44,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:44,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:44,104 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:44,104 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:44,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:44,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,106 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,106 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 12:02:44,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,106 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:44,106 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:44,106 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:44,107 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:44,107 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:44,107 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:44,107 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:44,107 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:44,532 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073e41df9f3b7a49b8bb9cedb661dd315e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509073e41df9f3b7a49b8bb9cedb661dd315e 2023-02-13 12:02:44,939 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/98b8ad12ea3c4737b67755418b939b73 2023-02-13 12:02:44,952 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/98b8ad12ea3c4737b67755418b939b73 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/98b8ad12ea3c4737b67755418b939b73 2023-02-13 12:02:44,956 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/98b8ad12ea3c4737b67755418b939b73, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 12:02:44,956 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 849ms, sequenceid=37, compaction requested=true 2023-02-13 12:02:44,956 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:44,956 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:44,956 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:44,956 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:44,957 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:44,957 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:44,957 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:44,987 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:44,987 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:44,987 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,988 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:44,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:44,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:44,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1104cf33[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:44,989 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:44,989 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,995 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:44,996 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:44,996 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:44,996 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:44,996 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:44,996 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:45,004 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:45,004 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,004 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:45,004 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:45,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:45,006 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:45,007 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:45,007 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:45,007 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,007 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:45,012 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,012 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:45,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,012 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:45,013 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,013 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:45,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,020 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:45,020 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:45,020 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:45,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:45,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:45,021 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,021 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,021 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,021 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:45,021 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,021 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:45,021 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:45,021 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,021 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:45,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:45,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:45,121 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:45,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:45,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:45,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 12:02:45,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,134 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:45,134 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:45,134 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 12:02:45,134 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 12:02:45,135 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,135 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,145 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:45,146 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:45,146 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:45,146 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:45,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,148 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 12:02:45,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:45,148 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 12:02:45,148 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:45,148 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 12:02:45,148 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:02:45,148 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:45,148 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:45,148 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. started... 2023-02-13 12:02:45,148 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58ec3f3b39089ccb03970dd0c83adb41 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:02:45,574 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120bc3d1db795f448a7a2eac6932b4c52af to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bc3d1db795f448a7a2eac6932b4c52af 2023-02-13 12:02:45,980 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/dcf24cc020e243cd91439b2e07f631c4 2023-02-13 12:02:45,992 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/dcf24cc020e243cd91439b2e07f631c4 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/dcf24cc020e243cd91439b2e07f631c4 2023-02-13 12:02:45,998 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/dcf24cc020e243cd91439b2e07f631c4, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 12:02:45,999 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 58ec3f3b39089ccb03970dd0c83adb41 in 851ms, sequenceid=41, compaction requested=true 2023-02-13 12:02:45,999 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:45,999 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:45,999 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:02:46,000 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:02:46,000 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,000 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 12:02:46,000 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 12:02:46,029 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,029 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:46,030 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:46,030 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:02:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:46,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:46,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 12:02:46,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f55b061[Count = 0] remaining members to acquire global barrier 2023-02-13 12:02:46,035 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 12:02:46,035 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,046 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,046 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 12:02:46,046 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 12:02:46,046 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:02:46,046 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,047 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:02:46,054 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 12:02:46,054 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,054 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:46,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:46,054 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 12:02:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:02:46,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 12:02:46,063 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 12:02:46,063 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:02:46,063 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:02:46,063 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,063 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:02:46,070 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,070 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,071 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:02:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:02:46,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:02:46,072 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:46,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:46,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:02:46,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,074 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:02:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,087 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,087 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:46,087 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:02:46,087 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 12:02:46,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:02:46,087 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:46,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,088 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 12:02:46,087 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:02:46,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:46,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:46,088 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:02:46,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:02:46,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:02:46,189 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:02:46,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:02:46,194 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:46,197 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 12:02:46,198 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 12:02:46,199 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290366199 2023-02-13 12:02:46,199 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:46,203 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:02:46,205 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 12:02:46,205 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:46,206 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x1afb397f to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:02:46,219 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62458b00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:02:46,220 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:47,102 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a95eb9fe1657434bac6c4fd355fc5c8c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103a95eb9fe1657434bac6c4fd355fc5c8c 2023-02-13 12:02:47,104 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:47,120 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:02:47,121 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:52748, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:02:47,128 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:02:47,129 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:52154, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:02:47,138 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2928b81c62d9422fb9dba8f748055998 first=Optional[r3] last=Optional[r6] 2023-02-13 12:02:47,138 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2928b81c62d9422fb9dba8f748055998}] 2023-02-13 12:02:47,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2928b81c62d9422fb9dba8f748055998 for inclusion in 58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:47,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 12:02:47,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:02:47,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:47,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2928b81c62d9422fb9dba8f748055998 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i0dlcst6h60rlq664u129k2j0p995ppui8h6k71ijiliah23rantc7pnh8s2fu35/family1/2928b81c62d9422fb9dba8f748055998 2023-02-13 12:02:47,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i0dlcst6h60rlq664u129k2j0p995ppui8h6k71ijiliah23rantc7pnh8s2fu35/family1/2928b81c62d9422fb9dba8f748055998 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/673e70875ef2431a8c2803f49ab5ea1b_SeqId_44_ 2023-02-13 12:02:47,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i0dlcst6h60rlq664u129k2j0p995ppui8h6k71ijiliah23rantc7pnh8s2fu35/family1/2928b81c62d9422fb9dba8f748055998 into 58ec3f3b39089ccb03970dd0c83adb41/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/673e70875ef2431a8c2803f49ab5ea1b_SeqId_44_ - updating store file list. 2023-02-13 12:02:47,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/673e70875ef2431a8c2803f49ab5ea1b_SeqId_44_ into 58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:47,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i0dlcst6h60rlq664u129k2j0p995ppui8h6k71ijiliah23rantc7pnh8s2fu35/family1/2928b81c62d9422fb9dba8f748055998 into 58ec3f3b39089ccb03970dd0c83adb41/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/673e70875ef2431a8c2803f49ab5ea1b_SeqId_44_) 2023-02-13 12:02:47,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i0dlcst6h60rlq664u129k2j0p995ppui8h6k71ijiliah23rantc7pnh8s2fu35/family1/2928b81c62d9422fb9dba8f748055998 2023-02-13 12:02:47,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 12:02:47,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 12:02:47,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 58ec3f3b39089ccb03970dd0c83adb41/family1 is initiating minor compaction 2023-02-13 12:02:47,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6fb9d464; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:47,158 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 58ec3f3b39089ccb03970dd0c83adb41/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:47,158 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/34ea7d573fdb42a09464e70bd9280932, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c094d81e6b9a422fb9998dbb87761053, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/84405ecccc204698becb591ec1c9c145, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c369a8d992c5493fb3eb18fecf917c7e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c3c5955ee2344adaaa750c7e983e1832, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/59b45eb45538494c95ae5b7b7c8b51d3, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/92970a3de984457bb2ceb4a52e800fa8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/98b8ad12ea3c4737b67755418b939b73, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/dcf24cc020e243cd91439b2e07f631c4, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/673e70875ef2431a8c2803f49ab5ea1b_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp, totalSize=50.3 K 2023-02-13 12:02:47,158 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 34ea7d573fdb42a09464e70bd9280932, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 12:02:47,158 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting c094d81e6b9a422fb9998dbb87761053, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 12:02:47,159 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 84405ecccc204698becb591ec1c9c145, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 12:02:47,159 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting c369a8d992c5493fb3eb18fecf917c7e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 12:02:47,159 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting c3c5955ee2344adaaa750c7e983e1832, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 12:02:47,159 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 59b45eb45538494c95ae5b7b7c8b51d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 12:02:47,159 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 92970a3de984457bb2ceb4a52e800fa8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 12:02:47,159 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 98b8ad12ea3c4737b67755418b939b73, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 12:02:47,159 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting dcf24cc020e243cd91439b2e07f631c4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 12:02:47,159 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 673e70875ef2431a8c2803f49ab5ea1b_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 12:02:47,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:47,161 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:47,162 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228da400f7dd22844399d4ed7343d73d4d8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228da400f7dd22844399d4ed7343d73d4d8 2023-02-13 12:02:47,164 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b041eccaa7d8493aad2c35b15c23365f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b041eccaa7d8493aad2c35b15c23365f 2023-02-13 12:02:47,165 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101c7023d67b95e4580b64522ea9d97aa54 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101c7023d67b95e4580b64522ea9d97aa54 2023-02-13 12:02:47,166 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103671b2f5eef5e4dd793e3afcf74038de5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103671b2f5eef5e4dd793e3afcf74038de5 2023-02-13 12:02:47,167 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-13 12:02:47,167 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 12:02:47,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:47,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:47,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:47,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:47,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:47,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:47,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:47,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:47,181 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): 58ec3f3b39089ccb03970dd0c83adb41#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:02:47,596 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/6785bdf1f14a462b90e1965cc49cd45a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/6785bdf1f14a462b90e1965cc49cd45a 2023-02-13 12:02:47,602 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 58ec3f3b39089ccb03970dd0c83adb41/family1 of 58ec3f3b39089ccb03970dd0c83adb41 into 6785bdf1f14a462b90e1965cc49cd45a(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:02:47,602 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:47,602 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676289767158; duration=0sec 2023-02-13 12:02:47,602 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:47,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/34ea7d573fdb42a09464e70bd9280932, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c094d81e6b9a422fb9998dbb87761053, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/84405ecccc204698becb591ec1c9c145, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c369a8d992c5493fb3eb18fecf917c7e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c3c5955ee2344adaaa750c7e983e1832, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/59b45eb45538494c95ae5b7b7c8b51d3, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/92970a3de984457bb2ceb4a52e800fa8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/98b8ad12ea3c4737b67755418b939b73, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/dcf24cc020e243cd91439b2e07f631c4, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/673e70875ef2431a8c2803f49ab5ea1b_SeqId_44_] to archive 2023-02-13 12:02:47,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:47,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/34ea7d573fdb42a09464e70bd9280932 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/34ea7d573fdb42a09464e70bd9280932 2023-02-13 12:02:47,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c094d81e6b9a422fb9998dbb87761053 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c094d81e6b9a422fb9998dbb87761053 2023-02-13 12:02:47,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/84405ecccc204698becb591ec1c9c145 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/84405ecccc204698becb591ec1c9c145 2023-02-13 12:02:47,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c369a8d992c5493fb3eb18fecf917c7e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c369a8d992c5493fb3eb18fecf917c7e 2023-02-13 12:02:47,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c3c5955ee2344adaaa750c7e983e1832 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/c3c5955ee2344adaaa750c7e983e1832 2023-02-13 12:02:47,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/59b45eb45538494c95ae5b7b7c8b51d3 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/59b45eb45538494c95ae5b7b7c8b51d3 2023-02-13 12:02:47,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/92970a3de984457bb2ceb4a52e800fa8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/92970a3de984457bb2ceb4a52e800fa8 2023-02-13 12:02:47,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/98b8ad12ea3c4737b67755418b939b73 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/98b8ad12ea3c4737b67755418b939b73 2023-02-13 12:02:47,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/dcf24cc020e243cd91439b2e07f631c4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/dcf24cc020e243cd91439b2e07f631c4 2023-02-13 12:02:47,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/673e70875ef2431a8c2803f49ab5ea1b_SeqId_44_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/673e70875ef2431a8c2803f49ab5ea1b_SeqId_44_ 2023-02-13 12:02:48,003 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120534f759adf59f4f7981a1dc20891fc67a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120534f759adf59f4f7981a1dc20891fc67a 2023-02-13 12:02:48,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:48,030 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d570ff02a28345f99b29746e4ee39389 first=Optional[r00] last=Optional[r2] 2023-02-13 12:02:48,030 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d570ff02a28345f99b29746e4ee39389}] 2023-02-13 12:02:48,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d570ff02a28345f99b29746e4ee39389 for inclusion in 58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:48,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 12:02:48,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:02:48,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:48,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d570ff02a28345f99b29746e4ee39389 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3mb3vtq2lve86ncnmn844e50jen76t8rlkurq9th165lmk91cr77l7hup3a7o8su/family1/d570ff02a28345f99b29746e4ee39389 2023-02-13 12:02:48,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3mb3vtq2lve86ncnmn844e50jen76t8rlkurq9th165lmk91cr77l7hup3a7o8su/family1/d570ff02a28345f99b29746e4ee39389 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/9073f13270894bb28888bf59c946d579_SeqId_47_ 2023-02-13 12:02:48,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3mb3vtq2lve86ncnmn844e50jen76t8rlkurq9th165lmk91cr77l7hup3a7o8su/family1/d570ff02a28345f99b29746e4ee39389 into 58ec3f3b39089ccb03970dd0c83adb41/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/9073f13270894bb28888bf59c946d579_SeqId_47_ - updating store file list. 2023-02-13 12:02:48,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/9073f13270894bb28888bf59c946d579_SeqId_47_ into 58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:48,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3mb3vtq2lve86ncnmn844e50jen76t8rlkurq9th165lmk91cr77l7hup3a7o8su/family1/d570ff02a28345f99b29746e4ee39389 into 58ec3f3b39089ccb03970dd0c83adb41/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/9073f13270894bb28888bf59c946d579_SeqId_47_) 2023-02-13 12:02:48,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3mb3vtq2lve86ncnmn844e50jen76t8rlkurq9th165lmk91cr77l7hup3a7o8su/family1/d570ff02a28345f99b29746e4ee39389 2023-02-13 12:02:48,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 12:02:48,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 12:02:48,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 58ec3f3b39089ccb03970dd0c83adb41/family1 is initiating minor compaction (all files) 2023-02-13 12:02:48,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2325fb4d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:48,047 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 58ec3f3b39089ccb03970dd0c83adb41/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:48,047 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/82aa1f9cb48a411ba63b6cfec6d412b2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/6785bdf1f14a462b90e1965cc49cd45a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/9073f13270894bb28888bf59c946d579_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp, totalSize=388.1 K 2023-02-13 12:02:48,048 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 82aa1f9cb48a411ba63b6cfec6d412b2, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807319 2023-02-13 12:02:48,048 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 6785bdf1f14a462b90e1965cc49cd45a, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207319 2023-02-13 12:02:48,049 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 9073f13270894bb28888bf59c946d579_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878807319 2023-02-13 12:02:48,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:48,050 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:48,051 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511306d153a7b6dc84f25bd3e2e10ee34431a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511306d153a7b6dc84f25bd3e2e10ee34431a 2023-02-13 12:02:48,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201ee48f8d565cf405baa888c148454a1bf to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201ee48f8d565cf405baa888c148454a1bf 2023-02-13 12:02:48,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052fceada9149e48479004a37cf35cdf43 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052fceada9149e48479004a37cf35cdf43 2023-02-13 12:02:48,054 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-13 12:02:48,054 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 12:02:48,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:48,054 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:48,055 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:48,056 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 12:02:48,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8610 sec 2023-02-13 12:02:48,066 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): 58ec3f3b39089ccb03970dd0c83adb41#family1#compaction#74 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:02:48,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 12:02:48,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:48,534 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 12:02:48,535 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 12:02:48,536 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 12:02:48,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 12:02:48,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, REOPEN/MOVE}] 2023-02-13 12:02:48,543 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, REOPEN/MOVE 2023-02-13 12:02:48,544 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:48,544 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289768544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289768544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289768544"}]},"ts":"1676289768544"} 2023-02-13 12:02:48,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:48,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:48,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 58ec3f3b39089ccb03970dd0c83adb41, disabling compactions & flushes 2023-02-13 12:02:48,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:49,308 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/.tmp/family1/59daa2010a19485b9790ac2fc91d71be as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/59daa2010a19485b9790ac2fc91d71be 2023-02-13 12:02:49,315 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 58ec3f3b39089ccb03970dd0c83adb41/family1 of 58ec3f3b39089ccb03970dd0c83adb41 into 59daa2010a19485b9790ac2fc91d71be(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:02:49,315 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:49,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:49,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:49,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. after waiting 0 ms 2023-02-13 12:02:49,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:49,315 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1676289768047; duration=1sec 2023-02-13 12:02:49,316 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:49,319 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/82aa1f9cb48a411ba63b6cfec6d412b2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/6785bdf1f14a462b90e1965cc49cd45a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/9073f13270894bb28888bf59c946d579_SeqId_47_] to archive 2023-02-13 12:02:49,320 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:49,323 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/82aa1f9cb48a411ba63b6cfec6d412b2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/82aa1f9cb48a411ba63b6cfec6d412b2 2023-02-13 12:02:49,324 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/6785bdf1f14a462b90e1965cc49cd45a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/6785bdf1f14a462b90e1965cc49cd45a 2023-02-13 12:02:49,326 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/9073f13270894bb28888bf59c946d579_SeqId_47_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/9073f13270894bb28888bf59c946d579_SeqId_47_ 2023-02-13 12:02:49,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 12:02:49,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:49,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 58ec3f3b39089ccb03970dd0c83adb41: Waiting for close lock at 1676289768699Running coprocessor pre-close hooks at 1676289768699Disabling compacts and flushes for region at 1676289768699Disabling writes for close at 1676289769315 (+616 ms)Writing region close event to WAL at 1676289769328 (+13 ms)Running coprocessor post-close hooks at 1676289769332 (+4 ms)Closed at 1676289769333 (+1 ms) 2023-02-13 12:02:49,333 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 58ec3f3b39089ccb03970dd0c83adb41 to self. 2023-02-13 12:02:49,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:49,335 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=CLOSED 2023-02-13 12:02:49,335 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289769335"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289769335"}]},"ts":"1676289769335"} 2023-02-13 12:02:49,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-13 12:02:49,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697 in 791 msec 2023-02-13 12:02:49,339 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=true 2023-02-13 12:02:49,489 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:49,490 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289769489"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289769489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289769489"}]},"ts":"1676289769489"} 2023-02-13 12:02:49,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:49,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:49,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 58ec3f3b39089ccb03970dd0c83adb41, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:02:49,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:49,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:49,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:49,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:49,658 INFO [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:49,660 DEBUG [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:49,660 DEBUG [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:49,660 INFO [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58ec3f3b39089ccb03970dd0c83adb41 columnFamilyName family1 2023-02-13 12:02:49,667 DEBUG [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/59daa2010a19485b9790ac2fc91d71be 2023-02-13 12:02:49,667 INFO [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] regionserver.HStore(310): Store=58ec3f3b39089ccb03970dd0c83adb41/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:49,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:49,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:49,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:49,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 58ec3f3b39089ccb03970dd0c83adb41; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70286207, jitterRate=0.047346100211143494}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:02:49,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 58ec3f3b39089ccb03970dd0c83adb41: Running coprocessor pre-open hook at 1676289769655Writing region info on filesystem at 1676289769655Initializing all the Stores at 1676289769657 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676289769657Cleaning up temporary data from old regions at 1676289769670 (+13 ms)Cleaning up detritus from prior splits at 1676289769670Running coprocessor post-open hooks at 1676289769673 (+3 ms)Region opened successfully at 1676289769673 2023-02-13 12:02:49,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41., pid=63, masterSystemTime=1676289769647 2023-02-13 12:02:49,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:49,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:49,675 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:49,675 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289769675"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289769675"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289769675"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289769675"}]},"ts":"1676289769675"} 2023-02-13 12:02:49,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-13 12:02:49,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697 in 183 msec 2023-02-13 12:02:49,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-13 12:02:49,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, REOPEN/MOVE in 1.1360 sec 2023-02-13 12:02:49,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-13 12:02:49,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1410 sec 2023-02-13 12:02:49,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5600 sec 2023-02-13 12:02:49,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-13 12:02:49,685 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(278): alter status finished 2023-02-13 12:02:49,686 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:49,687 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 12:02:49,688 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 12:02:49,689 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:49,689 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290369689 2023-02-13 12:02:49,689 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:02:49,690 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 12:02:49,690 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:49,691 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x2c9b8e28 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:02:49,721 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f1823d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:02:49,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:49,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:49,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:49,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:49,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:50,559 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ebef7825e6d14d94afffe911d7087f14 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128ebef7825e6d14d94afffe911d7087f14 2023-02-13 12:02:50,560 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:50,573 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:02:50,574 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36366, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:02:50,579 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:02:50,581 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45552, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:02:50,589 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e5da720063da4f169492ae35250ca324 first=Optional[r05] last=Optional[r8] 2023-02-13 12:02:50,590 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e5da720063da4f169492ae35250ca324}] 2023-02-13 12:02:50,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e5da720063da4f169492ae35250ca324 for inclusion in 58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:50,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 12:02:50,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:02:50,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 58ec3f3b39089ccb03970dd0c83adb41: 2023-02-13 12:02:50,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e5da720063da4f169492ae35250ca324 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qd25kkivqe39p5k1s3v8vqirb5197q7608ucf87nr3r864mafu88pgdlm777p3hl/family1/e5da720063da4f169492ae35250ca324 2023-02-13 12:02:50,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qd25kkivqe39p5k1s3v8vqirb5197q7608ucf87nr3r864mafu88pgdlm777p3hl/family1/e5da720063da4f169492ae35250ca324 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/f85c4a36394841fa95f0888091f0108b_SeqId_53_ 2023-02-13 12:02:50,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qd25kkivqe39p5k1s3v8vqirb5197q7608ucf87nr3r864mafu88pgdlm777p3hl/family1/e5da720063da4f169492ae35250ca324 into 58ec3f3b39089ccb03970dd0c83adb41/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/f85c4a36394841fa95f0888091f0108b_SeqId_53_ - updating store file list. 2023-02-13 12:02:50,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/f85c4a36394841fa95f0888091f0108b_SeqId_53_ into 58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:50,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qd25kkivqe39p5k1s3v8vqirb5197q7608ucf87nr3r864mafu88pgdlm777p3hl/family1/e5da720063da4f169492ae35250ca324 into 58ec3f3b39089ccb03970dd0c83adb41/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/f85c4a36394841fa95f0888091f0108b_SeqId_53_) 2023-02-13 12:02:50,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qd25kkivqe39p5k1s3v8vqirb5197q7608ucf87nr3r864mafu88pgdlm777p3hl/family1/e5da720063da4f169492ae35250ca324 2023-02-13 12:02:50,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:50,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:50,614 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bc3d1db795f448a7a2eac6932b4c52af to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bc3d1db795f448a7a2eac6932b4c52af 2023-02-13 12:02:50,615 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128677640c54c154902b498670c939823f1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128677640c54c154902b498670c939823f1 2023-02-13 12:02:50,616 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-13 12:02:50,616 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 12:02:50,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:50,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:50,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:50,616 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:50,616 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:50,617 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 12:02:50,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 930 msec 2023-02-13 12:02:50,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$12(2441): Client=jenkins//188.40.62.62 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-13 12:02:50,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:51,096 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 12:02:51,098 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 12:02:51,098 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 12:02:51,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 12:02:51,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, REOPEN/MOVE}] 2023-02-13 12:02:51,106 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, REOPEN/MOVE 2023-02-13 12:02:51,107 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:51,107 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289771106"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289771106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289771106"}]},"ts":"1676289771106"} 2023-02-13 12:02:51,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:51,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:51,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 58ec3f3b39089ccb03970dd0c83adb41, disabling compactions & flushes 2023-02-13 12:02:51,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:51,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:51,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. after waiting 0 ms 2023-02-13 12:02:51,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:51,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 12:02:51,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:51,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 58ec3f3b39089ccb03970dd0c83adb41: Waiting for close lock at 1676289771261Running coprocessor pre-close hooks at 1676289771261Disabling compacts and flushes for region at 1676289771261Disabling writes for close at 1676289771261Writing region close event to WAL at 1676289771273 (+12 ms)Running coprocessor post-close hooks at 1676289771281 (+8 ms)Closed at 1676289771281 2023-02-13 12:02:51,281 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 58ec3f3b39089ccb03970dd0c83adb41 to self. 2023-02-13 12:02:51,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:51,283 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=CLOSED 2023-02-13 12:02:51,283 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289771283"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289771283"}]},"ts":"1676289771283"} 2023-02-13 12:02:51,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-13 12:02:51,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697 in 176 msec 2023-02-13 12:02:51,286 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=true 2023-02-13 12:02:51,437 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:51,437 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289771437"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289771437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289771437"}]},"ts":"1676289771437"} 2023-02-13 12:02:51,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:51,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:51,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 58ec3f3b39089ccb03970dd0c83adb41, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:02:51,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:51,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:51,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:51,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:51,596 INFO [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:51,597 DEBUG [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:51,597 DEBUG [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1 2023-02-13 12:02:51,597 INFO [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58ec3f3b39089ccb03970dd0c83adb41 columnFamilyName family1 2023-02-13 12:02:51,604 DEBUG [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/59daa2010a19485b9790ac2fc91d71be 2023-02-13 12:02:51,608 DEBUG [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/family1/f85c4a36394841fa95f0888091f0108b_SeqId_53_ 2023-02-13 12:02:51,608 INFO [StoreOpener-58ec3f3b39089ccb03970dd0c83adb41-1] regionserver.HStore(310): Store=58ec3f3b39089ccb03970dd0c83adb41/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:51,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:51,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:51,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:02:51,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 58ec3f3b39089ccb03970dd0c83adb41; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70524141, jitterRate=0.05089159309864044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:02:51,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 58ec3f3b39089ccb03970dd0c83adb41: Running coprocessor pre-open hook at 1676289771594Writing region info on filesystem at 1676289771594Initializing all the Stores at 1676289771595 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676289771595Cleaning up temporary data from old regions at 1676289771611 (+16 ms)Cleaning up detritus from prior splits at 1676289771611Running coprocessor post-open hooks at 1676289771614 (+3 ms)Region opened successfully at 1676289771614 2023-02-13 12:02:51,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41., pid=69, masterSystemTime=1676289771590 2023-02-13 12:02:51,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:51,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:02:51,616 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=58ec3f3b39089ccb03970dd0c83adb41, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:51,616 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676289771616"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289771616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289771616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289771616"}]},"ts":"1676289771616"} 2023-02-13 12:02:51,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-13 12:02:51,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 58ec3f3b39089ccb03970dd0c83adb41, server=jenkins-hbase16.apache.org,39857,1676289663697 in 178 msec 2023-02-13 12:02:51,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-13 12:02:51,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=58ec3f3b39089ccb03970dd0c83adb41, REOPEN/MOVE in 513 msec 2023-02-13 12:02:51,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-13 12:02:51,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 519 msec 2023-02-13 12:02:51,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 936 msec 2023-02-13 12:02:51,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-13 12:02:51,624 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(278): alter status finished 2023-02-13 12:02:51,625 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 12:02:51,626 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 12:02:51,627 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 12:02:51,627 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:51,627 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290371627 2023-02-13 12:02:51,628 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:02:51,628 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 12:02:51,628 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:51,629 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x2352b291 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:02:51,663 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ea1532d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:02:51,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:51,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:51,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:51,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:51,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:51,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:51,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:51,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 12:02:51,663 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 12:02:51,663 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:51,664 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 12:02:51,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 39 msec 2023-02-13 12:02:51,724 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=240 (was 243), OpenFileDescriptor=613 (was 615), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=84 (was 107), ProcessCount=165 (was 165), AvailableMemoryMB=6060 (was 6088) 2023-02-13 12:02:51,733 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=84, ProcessCount=165, AvailableMemoryMB=6059 2023-02-13 12:02:51,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 12:02:51,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-13 12:02:51,738 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:02:51,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-13 12:02:51,739 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:02:51,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 12:02:51,740 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:51,741 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49 empty. 2023-02-13 12:02:51,741 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:51,741 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 12:02:51,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 12:02:52,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 12:02:52,175 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 12:02:52,179 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 37ad3b1694ca0282f367cbac54854a49, NAME => 'testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:02:52,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 12:02:52,591 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:52,591 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing 37ad3b1694ca0282f367cbac54854a49, disabling compactions & flushes 2023-02-13 12:02:52,591 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:52,591 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:52,591 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. after waiting 0 ms 2023-02-13 12:02:52,591 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:52,591 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:52,592 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 37ad3b1694ca0282f367cbac54854a49: Waiting for close lock at 1676289772591Disabling compacts and flushes for region at 1676289772591Disabling writes for close at 1676289772591Writing region close event to WAL at 1676289772591Closed at 1676289772591 2023-02-13 12:02:52,597 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:02:52,599 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676289772599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289772599"}]},"ts":"1676289772599"} 2023-02-13 12:02:52,600 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 12:02:52,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:02:52,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289772601"}]},"ts":"1676289772601"} 2023-02-13 12:02:52,602 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-13 12:02:52,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=37ad3b1694ca0282f367cbac54854a49, ASSIGN}] 2023-02-13 12:02:52,648 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=37ad3b1694ca0282f367cbac54854a49, ASSIGN 2023-02-13 12:02:52,650 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=37ad3b1694ca0282f367cbac54854a49, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:02:52,801 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=37ad3b1694ca0282f367cbac54854a49, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:52,802 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676289772801"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289772801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289772801"}]},"ts":"1676289772801"} 2023-02-13 12:02:52,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 37ad3b1694ca0282f367cbac54854a49, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:52,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 12:02:52,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:52,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 37ad3b1694ca0282f367cbac54854a49, NAME => 'testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:02:52,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-13 12:02:52,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-13 12:02:52,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:52,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:52,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:52,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:52,971 INFO [StoreOpener-37ad3b1694ca0282f367cbac54854a49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:52,973 DEBUG [StoreOpener-37ad3b1694ca0282f367cbac54854a49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1 2023-02-13 12:02:52,973 DEBUG [StoreOpener-37ad3b1694ca0282f367cbac54854a49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1 2023-02-13 12:02:52,973 INFO [StoreOpener-37ad3b1694ca0282f367cbac54854a49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37ad3b1694ca0282f367cbac54854a49 columnFamilyName f1 2023-02-13 12:02:52,975 INFO [StoreOpener-37ad3b1694ca0282f367cbac54854a49-1] regionserver.HStore(310): Store=37ad3b1694ca0282f367cbac54854a49/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:52,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:52,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:52,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:52,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:02:52,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 37ad3b1694ca0282f367cbac54854a49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73829569, jitterRate=0.10014630854129791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:02:52,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 37ad3b1694ca0282f367cbac54854a49: Running coprocessor pre-open hook at 1676289772970Writing region info on filesystem at 1676289772970Initializing all the Stores at 1676289772971 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289772971Cleaning up temporary data from old regions at 1676289772976 (+5 ms)Cleaning up detritus from prior splits at 1676289772977 (+1 ms)Running coprocessor post-open hooks at 1676289772981 (+4 ms)Region opened successfully at 1676289772981 2023-02-13 12:02:52,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49., pid=73, masterSystemTime=1676289772958 2023-02-13 12:02:52,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:52,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:52,983 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=37ad3b1694ca0282f367cbac54854a49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:52,983 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676289772983"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289772983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289772983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289772983"}]},"ts":"1676289772983"} 2023-02-13 12:02:52,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-13 12:02:52,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 37ad3b1694ca0282f367cbac54854a49, server=jenkins-hbase16.apache.org,39857,1676289663697 in 180 msec 2023-02-13 12:02:52,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-13 12:02:52,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=37ad3b1694ca0282f367cbac54854a49, ASSIGN in 340 msec 2023-02-13 12:02:52,989 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:02:52,989 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289772989"}]},"ts":"1676289772989"} 2023-02-13 12:02:52,990 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-13 12:02:53,017 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:02:53,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.2810 sec 2023-02-13 12:02:53,512 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-13 12:02:53,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 12:02:53,851 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-13 12:02:53,851 DEBUG [Listener at localhost.localdomain/40603] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-13 12:02:53,856 INFO [Listener at localhost.localdomain/40603] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 12:02:53,861 INFO [Listener at localhost.localdomain/40603] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-13 12:02:53,862 INFO [Listener at localhost.localdomain/40603] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 12:02:53,862 INFO [Listener at localhost.localdomain/40603] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-13 12:02:53,866 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2744): Flushing 37ad3b1694ca0282f367cbac54854a49 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 12:02:54,286 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213056383e7d69f4722be8a27a801309b25 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213056383e7d69f4722be8a27a801309b25 2023-02-13 12:02:54,695 INFO [Listener at localhost.localdomain/40603] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/.tmp/f1/101d230a0b6a420f9545d992b023c653 2023-02-13 12:02:54,705 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/.tmp/f1/101d230a0b6a420f9545d992b023c653 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653 2023-02-13 12:02:54,710 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 12:02:54,711 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 37ad3b1694ca0282f367cbac54854a49 in 845ms, sequenceid=5, compaction requested=false 2023-02-13 12:02:54,712 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2445): Flush status journal for 37ad3b1694ca0282f367cbac54854a49: 2023-02-13 12:02:54,714 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2744): Flushing 37ad3b1694ca0282f367cbac54854a49 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 12:02:54,865 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:02:55,130 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213980a01e7531f4313aa937908d1c200bd to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213980a01e7531f4313aa937908d1c200bd 2023-02-13 12:02:55,537 INFO [Listener at localhost.localdomain/40603] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/.tmp/f1/8d91b4a1ae8f49a398b622fce6cf25e3 2023-02-13 12:02:55,542 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/.tmp/f1/8d91b4a1ae8f49a398b622fce6cf25e3 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3 2023-02-13 12:02:55,547 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3, entries=1, sequenceid=9, filesize=4.9 K 2023-02-13 12:02:55,548 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 37ad3b1694ca0282f367cbac54854a49 in 834ms, sequenceid=9, compaction requested=false 2023-02-13 12:02:55,548 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2445): Flush status journal for 37ad3b1694ca0282f367cbac54854a49: 2023-02-13 12:02:55,549 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-13 12:02:55,550 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 12:02:55,551 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 12:02:55,552 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:55,552 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290375552 2023-02-13 12:02:55,552 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 12:02:55,552 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-13 12:02:55,552 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-13 12:02:55,553 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x63885c4c to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:02:55,601 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,601 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,653 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,653 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,698 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77a4432b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:02:55,698 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 12:02:55,705 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,705 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,756 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,756 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,807 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,807 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,857 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,857 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,908 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,908 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,959 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:55,959 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,011 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,011 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,062 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,062 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,114 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,114 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,144 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a73db4d66551426a8b49987eefdb9e4b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213a73db4d66551426a8b49987eefdb9e4b 2023-02-13 12:02:56,146 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 12:02:56,161 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:02:56,161 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36378, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:02:56,165 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,165 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,167 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:02:56,169 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45558, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:02:56,178 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/57ffbea7ad0e4853a543b71e3e050001 first=Optional[r1] last=Optional[r2] 2023-02-13 12:02:56,179 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/57ffbea7ad0e4853a543b71e3e050001}] 2023-02-13 12:02:56,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/57ffbea7ad0e4853a543b71e3e050001 for inclusion in 37ad3b1694ca0282f367cbac54854a49/f1 2023-02-13 12:02:56,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 12:02:56,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:02:56,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 37ad3b1694ca0282f367cbac54854a49: 2023-02-13 12:02:56,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/57ffbea7ad0e4853a543b71e3e050001 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testGetAfterCompaction__pp4uepkhhv23k0qu3hskddfp5fmckbb5c3padf31jfvcrq2ede1e72vi7lglknn1/f1/57ffbea7ad0e4853a543b71e3e050001 2023-02-13 12:02:56,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testGetAfterCompaction__pp4uepkhhv23k0qu3hskddfp5fmckbb5c3padf31jfvcrq2ede1e72vi7lglknn1/f1/57ffbea7ad0e4853a543b71e3e050001 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_ 2023-02-13 12:02:56,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testGetAfterCompaction__pp4uepkhhv23k0qu3hskddfp5fmckbb5c3padf31jfvcrq2ede1e72vi7lglknn1/f1/57ffbea7ad0e4853a543b71e3e050001 into 37ad3b1694ca0282f367cbac54854a49/f1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_ - updating store file list. 2023-02-13 12:02:56,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_ into 37ad3b1694ca0282f367cbac54854a49/f1 2023-02-13 12:02:56,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testGetAfterCompaction__pp4uepkhhv23k0qu3hskddfp5fmckbb5c3padf31jfvcrq2ede1e72vi7lglknn1/f1/57ffbea7ad0e4853a543b71e3e050001 into 37ad3b1694ca0282f367cbac54854a49/f1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_) 2023-02-13 12:02:56,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testGetAfterCompaction__pp4uepkhhv23k0qu3hskddfp5fmckbb5c3padf31jfvcrq2ede1e72vi7lglknn1/f1/57ffbea7ad0e4853a543b71e3e050001 2023-02-13 12:02:56,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 37ad3b1694ca0282f367cbac54854a49/f1 is initiating minor compaction 2023-02-13 12:02:56,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@528a1e38; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 12:02:56,196 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 37ad3b1694ca0282f367cbac54854a49/f1 in testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:56,197 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/.tmp, totalSize=10.0 K 2023-02-13 12:02:56,197 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 8d91b4a1ae8f49a398b622fce6cf25e3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 12:02:56,197 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 8664da0b31794e5dbe0080d28acbad9c_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 12:02:56,199 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 12:02:56,200 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:56,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213056383e7d69f4722be8a27a801309b25 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213056383e7d69f4722be8a27a801309b25 2023-02-13 12:02:56,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213980a01e7531f4313aa937908d1c200bd to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213980a01e7531f4313aa937908d1c200bd 2023-02-13 12:02:56,204 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-13 12:02:56,204 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 12:02:56,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 12:02:56,204 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-13 12:02:56,205 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:02:56,206 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 12:02:56,207 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): 37ad3b1694ca0282f367cbac54854a49#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:02:56,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 656 msec 2023-02-13 12:02:56,215 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,215 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,215 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,219 DEBUG [Listener at localhost.localdomain/40603] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 12:02:56,222 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36380, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 12:02:56,222 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39857] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:56,223 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-13 12:02:56,223 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 12:02:56,223 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39857] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 12:02:56,223 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39857] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. because compaction request was cancelled 2023-02-13 12:02:56,275 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,275 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,275 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,326 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,327 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,327 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,378 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,378 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,378 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,429 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,429 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,429 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,479 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,480 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,480 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,530 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,530 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,531 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,581 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,581 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,581 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,633 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,633 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,633 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,684 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,685 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,685 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,736 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,736 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,736 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,788 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,788 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,788 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,840 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,840 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,840 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,892 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,892 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,892 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,944 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,944 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,944 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,996 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:56,996 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:56,997 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:57,032 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/.tmp/f1/d785f8e34e294093af26df1f331f20a9 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/d785f8e34e294093af26df1f331f20a9 2023-02-13 12:02:57,039 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 37ad3b1694ca0282f367cbac54854a49/f1 of 37ad3b1694ca0282f367cbac54854a49 into d785f8e34e294093af26df1f331f20a9(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:02:57,039 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 37ad3b1694ca0282f367cbac54854a49: 2023-02-13 12:02:57,039 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676289776196; duration=0sec 2023-02-13 12:02:57,039 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:02:57,047 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:57,047 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:57,048 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:57,048 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/d785f8e34e294093af26df1f331f20a9; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676289777019; access_time=1676289776203; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:57,098 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:57,098 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676289776133; access_time=1676289775722; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 12:02:57,098 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289775536; access_time=1676289774716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:57,098 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/d785f8e34e294093af26df1f331f20a9; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676289777019; access_time=1676289776203; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:57,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_] to archive 2023-02-13 12:02:57,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:02:57,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8d91b4a1ae8f49a398b622fce6cf25e3 2023-02-13 12:02:57,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/8664da0b31794e5dbe0080d28acbad9c_SeqId_12_ 2023-02-13 12:02:57,149 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676289774694; access_time=1676289773869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:57,149 INFO [Listener at localhost.localdomain/40603] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/d785f8e34e294093af26df1f331f20a9; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676289777019; access_time=1676289776203; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 12:02:57,276 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-13 12:02:57,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$11(2405): Client=jenkins//188.40.62.62 disable testGetAfterCompaction 2023-02-13 12:02:57,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-13 12:02:57,287 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289777287"}]},"ts":"1676289777287"} 2023-02-13 12:02:57,288 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-13 12:02:57,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 12:02:57,328 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-13 12:02:57,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=37ad3b1694ca0282f367cbac54854a49, UNASSIGN}] 2023-02-13 12:02:57,332 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=37ad3b1694ca0282f367cbac54854a49, UNASSIGN 2023-02-13 12:02:57,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=37ad3b1694ca0282f367cbac54854a49, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:57,334 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676289777333"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289777333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289777333"}]},"ts":"1676289777333"} 2023-02-13 12:02:57,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 37ad3b1694ca0282f367cbac54854a49, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:57,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 12:02:57,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close 37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:57,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 37ad3b1694ca0282f367cbac54854a49, disabling compactions & flushes 2023-02-13 12:02:57,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:57,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:57,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. after waiting 0 ms 2023-02-13 12:02:57,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:57,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 12:02:57,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-13 12:02:57,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49. 2023-02-13 12:02:57,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 37ad3b1694ca0282f367cbac54854a49: Waiting for close lock at 1676289777491Running coprocessor pre-close hooks at 1676289777491Disabling compacts and flushes for region at 1676289777491Disabling writes for close at 1676289777491Writing region close event to WAL at 1676289777492 (+1 ms)Running coprocessor post-close hooks at 1676289777500 (+8 ms)Closed at 1676289777502 (+2 ms) 2023-02-13 12:02:57,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed 37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:57,505 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=37ad3b1694ca0282f367cbac54854a49, regionState=CLOSED 2023-02-13 12:02:57,505 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676289777505"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289777505"}]},"ts":"1676289777505"} 2023-02-13 12:02:57,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-13 12:02:57,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 37ad3b1694ca0282f367cbac54854a49, server=jenkins-hbase16.apache.org,39857,1676289663697 in 170 msec 2023-02-13 12:02:57,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-13 12:02:57,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=37ad3b1694ca0282f367cbac54854a49, UNASSIGN in 177 msec 2023-02-13 12:02:57,511 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289777511"}]},"ts":"1676289777511"} 2023-02-13 12:02:57,512 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-13 12:02:57,520 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-13 12:02:57,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 241 msec 2023-02-13 12:02:57,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 12:02:57,592 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-13 12:02:57,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$5(2215): Client=jenkins//188.40.62.62 delete testGetAfterCompaction 2023-02-13 12:02:57,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 12:02:57,609 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 12:02:57,610 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 12:02:57,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 12:02:57,613 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:57,616 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1, FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/recovered.edits] 2023-02-13 12:02:57,619 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/101d230a0b6a420f9545d992b023c653 2023-02-13 12:02:57,621 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/d785f8e34e294093af26df1f331f20a9 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/f1/d785f8e34e294093af26df1f331f20a9 2023-02-13 12:02:57,623 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/recovered.edits/15.seqid to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49/recovered.edits/15.seqid 2023-02-13 12:02:57,624 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testGetAfterCompaction/37ad3b1694ca0282f367cbac54854a49 2023-02-13 12:02:57,624 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 12:02:57,624 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 12:02:57,625 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-13 12:02:57,627 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213a73db4d66551426a8b49987eefdb9e4b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213a73db4d66551426a8b49987eefdb9e4b 2023-02-13 12:02:57,628 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 12:02:57,630 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 12:02:57,651 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-13 12:02:57,653 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-13 12:02:57,654 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 12:02:57,655 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-13 12:02:57,655 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676289777655"}]},"ts":"9223372036854775807"} 2023-02-13 12:02:57,656 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 12:02:57,656 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 37ad3b1694ca0282f367cbac54854a49, NAME => 'testGetAfterCompaction,,1676289771736.37ad3b1694ca0282f367cbac54854a49.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 12:02:57,656 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-13 12:02:57,656 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676289777656"}]},"ts":"9223372036854775807"} 2023-02-13 12:02:57,658 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-13 12:02:57,669 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 12:02:57,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 65 msec 2023-02-13 12:02:57,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 12:02:57,714 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-13 12:02:57,731 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244 (was 240) - Thread LEAK? -, OpenFileDescriptor=608 (was 613), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=77 (was 84), ProcessCount=165 (was 165), AvailableMemoryMB=6059 (was 6059) 2023-02-13 12:02:57,743 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=244, OpenFileDescriptor=608, MaxFileDescriptor=60000, SystemLoadAverage=77, ProcessCount=165, AvailableMemoryMB=6059 2023-02-13 12:02:57,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 12:02:57,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-13 12:02:57,750 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:02:57,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-13 12:02:57,751 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:02:57,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 12:02:57,754 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:57,754 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:57,754 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:57,754 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416 empty. 2023-02-13 12:02:57,754 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8 empty. 2023-02-13 12:02:57,754 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40 empty. 2023-02-13 12:02:57,755 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:57,755 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:57,755 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:57,755 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-13 12:02:57,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 12:02:58,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 12:02:58,169 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 12:02:58,172 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => a6f3edcaac9ede8077d2872e0a533416, NAME => 'testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:02:58,173 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1720c79b89223ff190ccb8a9ee0a2e40, NAME => 'testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:02:58,174 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8ee7954bd40bd1dafda1c1f1de68abb8, NAME => 'testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:02:58,187 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:58,187 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 1720c79b89223ff190ccb8a9ee0a2e40, disabling compactions & flushes 2023-02-13 12:02:58,187 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:02:58,187 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:02:58,187 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. after waiting 0 ms 2023-02-13 12:02:58,187 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:02:58,187 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:02:58,187 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 1720c79b89223ff190ccb8a9ee0a2e40: Waiting for close lock at 1676289778187Disabling compacts and flushes for region at 1676289778187Disabling writes for close at 1676289778187Writing region close event to WAL at 1676289778187Closed at 1676289778187 2023-02-13 12:02:58,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 12:02:58,588 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:58,588 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:58,588 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing a6f3edcaac9ede8077d2872e0a533416, disabling compactions & flushes 2023-02-13 12:02:58,589 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:02:58,589 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:02:58,589 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. after waiting 0 ms 2023-02-13 12:02:58,589 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 8ee7954bd40bd1dafda1c1f1de68abb8, disabling compactions & flushes 2023-02-13 12:02:58,589 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:02:58,589 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:02:58,589 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:02:58,590 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:02:58,590 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. after waiting 0 ms 2023-02-13 12:02:58,590 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for a6f3edcaac9ede8077d2872e0a533416: Waiting for close lock at 1676289778588Disabling compacts and flushes for region at 1676289778588Disabling writes for close at 1676289778589 (+1 ms)Writing region close event to WAL at 1676289778590 (+1 ms)Closed at 1676289778590 2023-02-13 12:02:58,590 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:02:58,590 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:02:58,590 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 8ee7954bd40bd1dafda1c1f1de68abb8: Waiting for close lock at 1676289778589Disabling compacts and flushes for region at 1676289778589Disabling writes for close at 1676289778590 (+1 ms)Writing region close event to WAL at 1676289778590Closed at 1676289778590 2023-02-13 12:02:58,595 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:02:58,597 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289778597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289778597"}]},"ts":"1676289778597"} 2023-02-13 12:02:58,597 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289778597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289778597"}]},"ts":"1676289778597"} 2023-02-13 12:02:58,597 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289778597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289778597"}]},"ts":"1676289778597"} 2023-02-13 12:02:58,600 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 12:02:58,601 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:02:58,601 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289778601"}]},"ts":"1676289778601"} 2023-02-13 12:02:58,603 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 12:02:58,627 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, ASSIGN}] 2023-02-13 12:02:58,629 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, ASSIGN 2023-02-13 12:02:58,629 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, ASSIGN 2023-02-13 12:02:58,629 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, ASSIGN 2023-02-13 12:02:58,630 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:02:58,630 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:02:58,630 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:02:58,783 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8ee7954bd40bd1dafda1c1f1de68abb8, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:58,783 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=a6f3edcaac9ede8077d2872e0a533416, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:58,783 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=1720c79b89223ff190ccb8a9ee0a2e40, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:58,784 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289778783"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289778783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289778783"}]},"ts":"1676289778783"} 2023-02-13 12:02:58,784 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289778783"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289778783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289778783"}]},"ts":"1676289778783"} 2023-02-13 12:02:58,784 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289778783"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289778783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289778783"}]},"ts":"1676289778783"} 2023-02-13 12:02:58,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure a6f3edcaac9ede8077d2872e0a533416, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:58,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 8ee7954bd40bd1dafda1c1f1de68abb8, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:58,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 1720c79b89223ff190ccb8a9ee0a2e40, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:02:58,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 12:02:58,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:02:58,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8ee7954bd40bd1dafda1c1f1de68abb8, NAME => 'testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 12:02:58,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:58,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:58,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:58,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:58,948 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:58,951 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1 2023-02-13 12:02:58,951 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1 2023-02-13 12:02:58,951 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ee7954bd40bd1dafda1c1f1de68abb8 columnFamilyName family1 2023-02-13 12:02:58,953 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(310): Store=8ee7954bd40bd1dafda1c1f1de68abb8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:58,953 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:58,955 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2 2023-02-13 12:02:58,955 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2 2023-02-13 12:02:58,955 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ee7954bd40bd1dafda1c1f1de68abb8 columnFamilyName family2 2023-02-13 12:02:58,957 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(310): Store=8ee7954bd40bd1dafda1c1f1de68abb8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:58,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:02:58,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:02:58,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:02:58,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 8ee7954bd40bd1dafda1c1f1de68abb8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72610675, jitterRate=0.08198337256908417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:02:58,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 8ee7954bd40bd1dafda1c1f1de68abb8: Running coprocessor pre-open hook at 1676289778947Writing region info on filesystem at 1676289778947Initializing all the Stores at 1676289778948 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289778948Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289778948Cleaning up temporary data from old regions at 1676289778959 (+11 ms)Cleaning up detritus from prior splits at 1676289778959Running coprocessor post-open hooks at 1676289778964 (+5 ms)Region opened successfully at 1676289778964 2023-02-13 12:02:58,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8., pid=84, masterSystemTime=1676289778941 2023-02-13 12:02:58,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:02:58,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:02:58,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:02:58,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a6f3edcaac9ede8077d2872e0a533416, NAME => 'testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 12:02:58,966 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8ee7954bd40bd1dafda1c1f1de68abb8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:58,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:58,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:58,967 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289778966"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289778966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289778966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289778966"}]},"ts":"1676289778966"} 2023-02-13 12:02:58,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:58,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:58,968 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:58,970 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1 2023-02-13 12:02:58,970 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1 2023-02-13 12:02:58,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-02-13 12:02:58,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 8ee7954bd40bd1dafda1c1f1de68abb8, server=jenkins-hbase16.apache.org,39857,1676289663697 in 181 msec 2023-02-13 12:02:58,970 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6f3edcaac9ede8077d2872e0a533416 columnFamilyName family1 2023-02-13 12:02:58,971 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(310): Store=a6f3edcaac9ede8077d2872e0a533416/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:58,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, ASSIGN in 344 msec 2023-02-13 12:02:58,971 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:58,972 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2 2023-02-13 12:02:58,973 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2 2023-02-13 12:02:58,973 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6f3edcaac9ede8077d2872e0a533416 columnFamilyName family2 2023-02-13 12:02:58,974 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(310): Store=a6f3edcaac9ede8077d2872e0a533416/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:58,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:58,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:58,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:02:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:02:58,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:02:58,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened a6f3edcaac9ede8077d2872e0a533416; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73506456, jitterRate=0.09533154964447021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:02:58,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for a6f3edcaac9ede8077d2872e0a533416: Running coprocessor pre-open hook at 1676289778967Writing region info on filesystem at 1676289778967Initializing all the Stores at 1676289778968 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289778968Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289778968Cleaning up temporary data from old regions at 1676289778975 (+7 ms)Cleaning up detritus from prior splits at 1676289778976 (+1 ms)Running coprocessor post-open hooks at 1676289778981 (+5 ms)Region opened successfully at 1676289778981 2023-02-13 12:02:58,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416., pid=83, masterSystemTime=1676289778941 2023-02-13 12:02:58,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:02:58,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:02:58,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:02:58,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1720c79b89223ff190ccb8a9ee0a2e40, NAME => 'testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 12:02:58,984 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=a6f3edcaac9ede8077d2872e0a533416, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:58,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:58,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:02:58,984 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289778983"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289778983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289778983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289778983"}]},"ts":"1676289778983"} 2023-02-13 12:02:58,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:58,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:58,986 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:58,987 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1 2023-02-13 12:02:58,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-02-13 12:02:58,987 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1 2023-02-13 12:02:58,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure a6f3edcaac9ede8077d2872e0a533416, server=jenkins-hbase16.apache.org,39857,1676289663697 in 199 msec 2023-02-13 12:02:58,988 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1720c79b89223ff190ccb8a9ee0a2e40 columnFamilyName family1 2023-02-13 12:02:58,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, ASSIGN in 361 msec 2023-02-13 12:02:58,988 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(310): Store=1720c79b89223ff190ccb8a9ee0a2e40/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:58,989 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:58,990 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2 2023-02-13 12:02:58,990 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2 2023-02-13 12:02:58,990 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1720c79b89223ff190ccb8a9ee0a2e40 columnFamilyName family2 2023-02-13 12:02:58,991 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(310): Store=1720c79b89223ff190ccb8a9ee0a2e40/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:02:58,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:58,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:58,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:02:58,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:02:58,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:02:58,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 1720c79b89223ff190ccb8a9ee0a2e40; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58788137, jitterRate=-0.12398849427700043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:02:58,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 1720c79b89223ff190ccb8a9ee0a2e40: Running coprocessor pre-open hook at 1676289778984Writing region info on filesystem at 1676289778984Initializing all the Stores at 1676289778985 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289778985Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289778985Cleaning up temporary data from old regions at 1676289778992 (+7 ms)Cleaning up detritus from prior splits at 1676289778992Running coprocessor post-open hooks at 1676289778996 (+4 ms)Region opened successfully at 1676289778996 2023-02-13 12:02:58,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40., pid=85, masterSystemTime=1676289778941 2023-02-13 12:02:58,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:02:58,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:02:58,998 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=1720c79b89223ff190ccb8a9ee0a2e40, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:58,998 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289778998"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289778998"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289778998"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289778998"}]},"ts":"1676289778998"} 2023-02-13 12:02:59,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-02-13 12:02:59,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 1720c79b89223ff190ccb8a9ee0a2e40, server=jenkins-hbase16.apache.org,39857,1676289663697 in 210 msec 2023-02-13 12:02:59,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=79 2023-02-13 12:02:59,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, ASSIGN in 374 msec 2023-02-13 12:02:59,003 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:02:59,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289779003"}]},"ts":"1676289779003"} 2023-02-13 12:02:59,004 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 12:02:59,012 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:02:59,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2650 sec 2023-02-13 12:02:59,515 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-13 12:02:59,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 12:02:59,863 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-13 12:02:59,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:02:59,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:02:59,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:02:59,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:02:59,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 12:02:59,882 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 12:02:59,883 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:59,883 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 12:02:59,883 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 12:02:59,883 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:02:59,883 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:02:59,911 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:59,911 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:02:59,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:02:59,912 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:02:59,912 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:02:59,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:02:59,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:02:59,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:02:59,913 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 12:02:59,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 12:02:59,913 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 12:02:59,913 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:02:59,913 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 12:02:59,913 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:02:59,913 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. started... 2023-02-13 12:02:59,914 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:02:59,914 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:02:59,914 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:02:59,914 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:02:59,914 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. started... 2023-02-13 12:02:59,914 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1720c79b89223ff190ccb8a9ee0a2e40 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 12:02:59,914 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. started... 2023-02-13 12:02:59,915 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a6f3edcaac9ede8077d2872e0a533416 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 12:02:59,915 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ee7954bd40bd1dafda1c1f1de68abb8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 12:03:00,341 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213cd865ad2381249e5afca9f2669c964e2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213cd865ad2381249e5afca9f2669c964e2 2023-02-13 12:03:00,341 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302135708ebc13435471da46c7eeac9836dc0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135708ebc13435471da46c7eeac9836dc0 2023-02-13 12:03:00,342 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302138baef262e654434da997f58c60408a89 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138baef262e654434da997f58c60408a89 2023-02-13 12:03:00,748 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/bdac2c2855f842bc8fdce950c6a4d20d 2023-02-13 12:03:00,748 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/0a5a394bf83a414f988e525d1d5a439e 2023-02-13 12:03:00,749 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/d146e457d6fd468698e71119ef297d9a 2023-02-13 12:03:01,181 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213c5330500c74f4f538a673a63920e4aa3 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c5330500c74f4f538a673a63920e4aa3 2023-02-13 12:03:01,181 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021379833570038e4147a73e6e9c9f74ed32 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021379833570038e4147a73e6e9c9f74ed32 2023-02-13 12:03:01,181 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302137c5d1cde5e1649b6b34282a81e041268 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302137c5d1cde5e1649b6b34282a81e041268 2023-02-13 12:03:01,590 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/1bafa769e7c84ad286b828002b2e166a 2023-02-13 12:03:01,590 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/e94601520c5647d6a976976240480ed1 2023-02-13 12:03:01,590 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/f2f764658363435985293fad4ef281a8 2023-02-13 12:03:01,597 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/bdac2c2855f842bc8fdce950c6a4d20d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/bdac2c2855f842bc8fdce950c6a4d20d 2023-02-13 12:03:01,597 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/d146e457d6fd468698e71119ef297d9a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/d146e457d6fd468698e71119ef297d9a 2023-02-13 12:03:01,597 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/0a5a394bf83a414f988e525d1d5a439e as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/0a5a394bf83a414f988e525d1d5a439e 2023-02-13 12:03:01,601 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/0a5a394bf83a414f988e525d1d5a439e, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 12:03:01,601 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/d146e457d6fd468698e71119ef297d9a, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 12:03:01,601 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/bdac2c2855f842bc8fdce950c6a4d20d, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 12:03:01,601 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/f2f764658363435985293fad4ef281a8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/f2f764658363435985293fad4ef281a8 2023-02-13 12:03:01,601 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/1bafa769e7c84ad286b828002b2e166a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/1bafa769e7c84ad286b828002b2e166a 2023-02-13 12:03:01,602 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/e94601520c5647d6a976976240480ed1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/e94601520c5647d6a976976240480ed1 2023-02-13 12:03:01,605 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/f2f764658363435985293fad4ef281a8, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 12:03:01,605 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/1bafa769e7c84ad286b828002b2e166a, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 12:03:01,606 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1720c79b89223ff190ccb8a9ee0a2e40 in 1692ms, sequenceid=5, compaction requested=false 2023-02-13 12:03:01,606 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8ee7954bd40bd1dafda1c1f1de68abb8 in 1691ms, sequenceid=5, compaction requested=false 2023-02-13 12:03:01,607 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:01,607 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:01,607 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:01,607 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:01,607 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:01,607 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:01,607 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/e94601520c5647d6a976976240480ed1, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 12:03:01,608 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a6f3edcaac9ede8077d2872e0a533416 in 1693ms, sequenceid=5, compaction requested=false 2023-02-13 12:03:01,608 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:01,608 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:01,608 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:01,608 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:01,608 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,608 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 12:03:01,608 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 12:03:01,636 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:01,636 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:01,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:01,637 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:01,637 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:01,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:01,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:01,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:01,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:01,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 12:03:01,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70ff2b97[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:01,640 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 12:03:01,640 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:01,645 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:01,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:01,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:01,645 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 12:03:01,645 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 12:03:01,645 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:01,645 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,645 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:01,653 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 12:03:01,653 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:01,653 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 12:03:01,653 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:01,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:01,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:01,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:01,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 12:03:01,660 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 12:03:01,660 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:01,660 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:01,660 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 12:03:01,660 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:01,670 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:01,670 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:01,670 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:01,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:01,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:01,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:01,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:01,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:01,672 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:01,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:01,674 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:01,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:01,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,686 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,686 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:01,686 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:01,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:01,687 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:01,687 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,687 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:01,687 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:01,687 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:01,686 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:01,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 12:03:01,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 12:03:01,686 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:01,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:01,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:01,687 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:01,688 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:01,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:01,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:01,788 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:01,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:01,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:01,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:01,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:01,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:01,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:01,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 12:03:01,797 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 12:03:01,797 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:01,797 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 12:03:01,797 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 12:03:01,797 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:01,798 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:01,803 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:01,803 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:01,803 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:01,804 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:01,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:01,805 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 12:03:01,805 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 12:03:01,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 12:03:01,805 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 12:03:01,805 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:01,805 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 12:03:01,805 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:01,805 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. started... 2023-02-13 12:03:01,805 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:01,805 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. started... 2023-02-13 12:03:01,805 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:01,805 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:03:01,806 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:01,805 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ee7954bd40bd1dafda1c1f1de68abb8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 12:03:01,805 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. started... 2023-02-13 12:03:01,805 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1720c79b89223ff190ccb8a9ee0a2e40 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 12:03:01,806 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a6f3edcaac9ede8077d2872e0a533416 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 12:03:02,225 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302137c4c1fdd91234e5ea6ddbbec92505ea7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137c4c1fdd91234e5ea6ddbbec92505ea7 2023-02-13 12:03:02,225 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213657f9ca972404f96b656baf96bd73fd0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213657f9ca972404f96b656baf96bd73fd0 2023-02-13 12:03:02,226 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302138b4465b0514c4bb6a0aa8d83b9b3d879 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138b4465b0514c4bb6a0aa8d83b9b3d879 2023-02-13 12:03:02,640 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/8eca9b704694444cb85cfd0aaf3c767d 2023-02-13 12:03:02,640 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/de8f86d8ef124e78aa4321759f9ba242 2023-02-13 12:03:02,640 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/118d505c73fe491eb7a1f5597b9456cc 2023-02-13 12:03:03,006 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:03:03,067 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213dbb35e707e2b4fafa7bda838c1192f3b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213dbb35e707e2b4fafa7bda838c1192f3b 2023-02-13 12:03:03,067 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213363fdc6be0e44e9dbec39c1c18bcd5ab to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213363fdc6be0e44e9dbec39c1c18bcd5ab 2023-02-13 12:03:03,067 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021347fe77417f1442009613b2ffb80665ec to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021347fe77417f1442009613b2ffb80665ec 2023-02-13 12:03:03,476 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/6d98e29bb13446f78e6aace4e2d6e5ff 2023-02-13 12:03:03,477 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/ee8387d608124fe09f646c11760c909e 2023-02-13 12:03:03,477 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/12cce83299ed46d696cb3dd95fd7e722 2023-02-13 12:03:03,486 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/118d505c73fe491eb7a1f5597b9456cc as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/118d505c73fe491eb7a1f5597b9456cc 2023-02-13 12:03:03,486 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/de8f86d8ef124e78aa4321759f9ba242 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/de8f86d8ef124e78aa4321759f9ba242 2023-02-13 12:03:03,486 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/8eca9b704694444cb85cfd0aaf3c767d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/8eca9b704694444cb85cfd0aaf3c767d 2023-02-13 12:03:03,491 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/de8f86d8ef124e78aa4321759f9ba242, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 12:03:03,491 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/8eca9b704694444cb85cfd0aaf3c767d, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 12:03:03,491 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/118d505c73fe491eb7a1f5597b9456cc, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 12:03:03,491 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/ee8387d608124fe09f646c11760c909e as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ee8387d608124fe09f646c11760c909e 2023-02-13 12:03:03,491 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/6d98e29bb13446f78e6aace4e2d6e5ff as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/6d98e29bb13446f78e6aace4e2d6e5ff 2023-02-13 12:03:03,491 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/12cce83299ed46d696cb3dd95fd7e722 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/12cce83299ed46d696cb3dd95fd7e722 2023-02-13 12:03:03,496 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ee8387d608124fe09f646c11760c909e, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 12:03:03,496 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/6d98e29bb13446f78e6aace4e2d6e5ff, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 12:03:03,496 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/12cce83299ed46d696cb3dd95fd7e722, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 12:03:03,497 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a6f3edcaac9ede8077d2872e0a533416 in 1691ms, sequenceid=9, compaction requested=false 2023-02-13 12:03:03,497 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1720c79b89223ff190ccb8a9ee0a2e40 in 1692ms, sequenceid=9, compaction requested=false 2023-02-13 12:03:03,497 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:03,497 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:03,497 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:03,497 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:03,497 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8ee7954bd40bd1dafda1c1f1de68abb8 in 1692ms, sequenceid=9, compaction requested=false 2023-02-13 12:03:03,497 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:03,497 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:03,497 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:03,497 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:03,497 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:03,497 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:03,497 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,497 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 12:03:03,497 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 12:03:03,511 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,511 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:03,512 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:03,512 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:03,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:03,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:03,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:03,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:03,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 12:03:03,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3952e1db[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:03,514 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 12:03:03,515 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:03,520 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:03,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:03,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:03,520 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 12:03:03,520 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 12:03:03,520 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:03,520 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,520 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:03,528 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 12:03:03,528 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,528 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:03,528 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 12:03:03,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:03,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:03,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:03,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:03,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:03,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:03,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 12:03:03,534 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 12:03:03,534 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:03,534 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:03,534 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 12:03:03,534 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:03,544 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:03,545 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:03,545 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:03,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:03,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:03,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:03,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:03,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:03,545 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:03,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:03,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:03,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:03,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:03,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:03,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:03,547 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:03,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:03,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:03,553 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:03,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 12:03:03,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 12:03:03,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:03,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:03,553 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:03,554 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:03,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:03,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:03,654 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:03,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:03,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:03,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:03,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:03,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:03,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:03,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 12:03:03,668 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 12:03:03,668 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:03,668 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 12:03:03,668 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 12:03:03,669 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:03,669 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:03,678 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:03,678 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:03,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:03,678 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:03,678 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:03,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:03,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:03,679 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 12:03:03,679 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 12:03:03,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 12:03:03,680 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 12:03:03,680 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:03,680 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 12:03:03,680 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:03,680 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. started... 2023-02-13 12:03:03,680 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:03,680 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. started... 2023-02-13 12:03:03,680 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:03,680 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:03:03,680 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:03,680 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ee7954bd40bd1dafda1c1f1de68abb8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 12:03:03,680 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. started... 2023-02-13 12:03:03,680 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1720c79b89223ff190ccb8a9ee0a2e40 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 12:03:03,680 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a6f3edcaac9ede8077d2872e0a533416 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 12:03:04,099 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021359806a53616a4990b523e65a17a0ae8a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021359806a53616a4990b523e65a17a0ae8a 2023-02-13 12:03:04,100 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302136bc33b7545c84473af738e49243037e7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302136bc33b7545c84473af738e49243037e7 2023-02-13 12:03:04,100 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302139fdff0434e8d4d9d9ba42be4bf419bf7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139fdff0434e8d4d9d9ba42be4bf419bf7 2023-02-13 12:03:04,505 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/a6f1a4a79535415a8c4f22ca595118b5 2023-02-13 12:03:04,505 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/ff70dcab71974ee689c282bdf9b306a1 2023-02-13 12:03:04,506 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/7e203aee01d64da7b4116873e4b7d4c0 2023-02-13 12:03:04,933 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021328f946d776654d1084dec27e0714e724 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021328f946d776654d1084dec27e0714e724 2023-02-13 12:03:04,933 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213360a9bb926744265bf23c5f27c907a0e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213360a9bb926744265bf23c5f27c907a0e 2023-02-13 12:03:04,933 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302131b85364a46204b528e754314b164387e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131b85364a46204b528e754314b164387e 2023-02-13 12:03:04,937 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/d58fda5c28374897bf0e579a35d076e2 2023-02-13 12:03:04,940 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/a6f1a4a79535415a8c4f22ca595118b5 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/a6f1a4a79535415a8c4f22ca595118b5 2023-02-13 12:03:04,943 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/a6f1a4a79535415a8c4f22ca595118b5, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 12:03:04,944 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/d58fda5c28374897bf0e579a35d076e2 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/d58fda5c28374897bf0e579a35d076e2 2023-02-13 12:03:04,947 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/d58fda5c28374897bf0e579a35d076e2, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 12:03:04,947 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a6f3edcaac9ede8077d2872e0a533416 in 1267ms, sequenceid=13, compaction requested=true 2023-02-13 12:03:04,947 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:04,947 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:04,947 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:05,337 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/2329f066e769429ea9b15082dda45516 2023-02-13 12:03:05,338 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/d9ca5e447a8a4a818bb6d80d89f5a04b 2023-02-13 12:03:05,345 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/7e203aee01d64da7b4116873e4b7d4c0 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/7e203aee01d64da7b4116873e4b7d4c0 2023-02-13 12:03:05,346 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/ff70dcab71974ee689c282bdf9b306a1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/ff70dcab71974ee689c282bdf9b306a1 2023-02-13 12:03:05,351 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/7e203aee01d64da7b4116873e4b7d4c0, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 12:03:05,352 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/ff70dcab71974ee689c282bdf9b306a1, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 12:03:05,352 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/2329f066e769429ea9b15082dda45516 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/2329f066e769429ea9b15082dda45516 2023-02-13 12:03:05,353 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/d9ca5e447a8a4a818bb6d80d89f5a04b as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/d9ca5e447a8a4a818bb6d80d89f5a04b 2023-02-13 12:03:05,358 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/d9ca5e447a8a4a818bb6d80d89f5a04b, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 12:03:05,358 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/2329f066e769429ea9b15082dda45516, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 12:03:05,359 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8ee7954bd40bd1dafda1c1f1de68abb8 in 1679ms, sequenceid=13, compaction requested=true 2023-02-13 12:03:05,359 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1720c79b89223ff190ccb8a9ee0a2e40 in 1679ms, sequenceid=13, compaction requested=true 2023-02-13 12:03:05,359 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:05,359 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:05,360 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:05,360 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:05,360 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:05,360 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:05,360 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:05,360 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,360 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 12:03:05,360 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 12:03:05,395 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,395 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:05,395 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:05,396 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:05,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:05,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:05,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 12:03:05,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e18dc95[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:05,399 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 12:03:05,399 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:05,409 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:05,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:05,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:05,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 12:03:05,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 12:03:05,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:05,410 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,410 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:05,420 DEBUG [regionserver/jenkins-hbase16:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 12:03:05,440 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,440 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 12:03:05,440 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:05,441 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 12:03:05,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:05,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:05,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:05,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:05,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:05,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:05,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:05,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 12:03:05,451 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 12:03:05,451 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:05,451 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:05,451 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 12:03:05,451 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:05,468 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:05,468 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:05,468 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:05,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:05,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:05,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:05,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:05,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:05,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:05,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:05,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:05,470 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:05,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:05,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:05,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:05,473 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:05,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:05,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:05,486 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:05,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:05,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:05,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,487 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:05,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 12:03:05,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:05,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:05,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:05,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 12:03:05,487 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:05,487 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:05,487 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:05,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:05,487 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:05,587 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:05,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:05,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:05,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:05,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:05,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:05,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:05,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 12:03:05,598 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 12:03:05,599 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:05,599 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 12:03:05,599 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 12:03:05,599 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:05,599 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:05,609 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:05,609 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:05,610 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:05,610 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:05,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:05,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:05,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:05,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:05,612 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 12:03:05,612 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 12:03:05,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 12:03:05,612 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 12:03:05,612 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:05,612 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 12:03:05,612 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:05,612 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. started... 2023-02-13 12:03:05,613 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:05,613 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:03:05,613 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:05,613 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. started... 2023-02-13 12:03:05,613 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:05,613 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a6f3edcaac9ede8077d2872e0a533416 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 12:03:05,613 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1720c79b89223ff190ccb8a9ee0a2e40 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 12:03:05,613 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. started... 2023-02-13 12:03:05,613 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ee7954bd40bd1dafda1c1f1de68abb8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 12:03:06,040 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ef71206b667443b29e87b9b6fe1e58c2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ef71206b667443b29e87b9b6fe1e58c2 2023-02-13 12:03:06,060 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:03:06,060 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1afb397f to 127.0.0.1:62284 2023-02-13 12:03:06,060 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:03:06,060 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:03:06,060 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c9b8e28 to 127.0.0.1:62284 2023-02-13 12:03:06,060 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:03:06,060 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:03:06,060 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63885c4c to 127.0.0.1:62284 2023-02-13 12:03:06,060 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:03:06,061 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302134f6a82906a024172a83b59dcaeabe10f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134f6a82906a024172a83b59dcaeabe10f 2023-02-13 12:03:06,061 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2352b291 to 127.0.0.1:62284 2023-02-13 12:03:06,061 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:03:06,061 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021396bfd51cf01c432fa06fd872cc19033c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021396bfd51cf01c432fa06fd872cc19033c 2023-02-13 12:03:06,470 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/fc011753471f43d0899fbce127326f77 2023-02-13 12:03:06,470 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/f845fb56af5347828fe5d72c0005c3d9 2023-02-13 12:03:06,474 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/7c65a056477b4ceebcc6ce4d80280b8f 2023-02-13 12:03:06,903 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213b707310cdf0244458dad0fa27e8b8663 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213b707310cdf0244458dad0fa27e8b8663 2023-02-13 12:03:06,903 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213f9fdff73d366477996c13a082e1918cb to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f9fdff73d366477996c13a082e1918cb 2023-02-13 12:03:06,903 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302136b751d73b976469da3e54a28a229bcf6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302136b751d73b976469da3e54a28a229bcf6 2023-02-13 12:03:07,309 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/5cc8e607d31e4ac8b676cba70b765713 2023-02-13 12:03:07,309 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/ecd6814835be4497af4559cb933cb9f4 2023-02-13 12:03:07,314 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/25e90067726942538cadd24fec06682c 2023-02-13 12:03:07,320 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/fc011753471f43d0899fbce127326f77 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/fc011753471f43d0899fbce127326f77 2023-02-13 12:03:07,320 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/7c65a056477b4ceebcc6ce4d80280b8f as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/7c65a056477b4ceebcc6ce4d80280b8f 2023-02-13 12:03:07,323 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/f845fb56af5347828fe5d72c0005c3d9 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/f845fb56af5347828fe5d72c0005c3d9 2023-02-13 12:03:07,325 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/fc011753471f43d0899fbce127326f77, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 12:03:07,325 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/7c65a056477b4ceebcc6ce4d80280b8f, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 12:03:07,325 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/5cc8e607d31e4ac8b676cba70b765713 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/5cc8e607d31e4ac8b676cba70b765713 2023-02-13 12:03:07,326 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/ecd6814835be4497af4559cb933cb9f4 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ecd6814835be4497af4559cb933cb9f4 2023-02-13 12:03:07,326 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/f845fb56af5347828fe5d72c0005c3d9, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 12:03:07,327 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/25e90067726942538cadd24fec06682c as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/25e90067726942538cadd24fec06682c 2023-02-13 12:03:07,329 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/5cc8e607d31e4ac8b676cba70b765713, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 12:03:07,329 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ecd6814835be4497af4559cb933cb9f4, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 12:03:07,330 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8ee7954bd40bd1dafda1c1f1de68abb8 in 1717ms, sequenceid=17, compaction requested=true 2023-02-13 12:03:07,330 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a6f3edcaac9ede8077d2872e0a533416 in 1717ms, sequenceid=17, compaction requested=true 2023-02-13 12:03:07,330 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:07,330 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:07,330 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:07,330 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:07,330 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:07,330 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:07,331 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/25e90067726942538cadd24fec06682c, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 12:03:07,331 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1720c79b89223ff190ccb8a9ee0a2e40 in 1718ms, sequenceid=17, compaction requested=true 2023-02-13 12:03:07,331 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:07,331 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:07,331 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:07,331 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:07,331 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,331 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 12:03:07,331 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 12:03:07,361 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,361 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:07,362 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:07,362 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:07,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:07,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 12:03:07,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c8ca38f[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:07,366 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 12:03:07,366 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:07,376 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:07,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:07,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:07,376 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 12:03:07,376 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 12:03:07,376 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:07,376 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,377 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:07,386 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,386 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 12:03:07,387 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:07,387 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 12:03:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:07,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:07,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:07,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:07,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:07,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:07,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:07,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 12:03:07,395 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 12:03:07,395 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:07,395 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:07,396 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 12:03:07,396 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:07,403 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:07,403 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:07,403 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:07,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:07,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:07,403 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,404 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:07,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:07,411 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:07,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:07,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 12:03:07,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:07,411 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:07,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:07,412 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:07,512 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:07,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:07,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1580): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 12:03:07,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676289787528 (current time:1676289787528). 2023-02-13 12:03:07,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 12:03:07,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] zookeeper.ReadOnlyZKClient(139): Connect 0x73af6aed to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:03:07,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c9e36c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:03:07,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:03:07,551 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47024, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:03:07,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73af6aed to 127.0.0.1:62284 2023-02-13 12:03:07,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:03:07,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 12:03:07,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 12:03:07,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 12:03:07,565 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 12:03:07,565 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676290387565 2023-02-13 12:03:07,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 12:03:07,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676289787514 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 12:03:07,566 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 12:03:07,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2 msec 2023-02-13 12:03:07,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 12:03:07,568 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 12:03:07,568 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676290387568 2023-02-13 12:03:07,570 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:07,570 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 12:03:07,671 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:07,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:07,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 12:03:07,678 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 12:03:07,878 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:07,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:07,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 12:03:07,880 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 12:03:07,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676289787514 2023-02-13 12:03:07,979 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676289787514' 2023-02-13 12:03:07,980 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 12:03:07,980 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676289787514' starting 'acquire' 2023-02-13 12:03:07,980 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676289787514', kicking off acquire phase on members. 2023-02-13 12:03:07,981 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676289787514 2023-02-13 12:03:07,981 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676289787514 2023-02-13 12:03:08,011 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 12:03:08,012 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 12:03:08,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 12:03:08,013 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,013 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:08,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676289787514 2023-02-13 12:03:08,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676289787514 2023-02-13 12:03:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 12:03:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676289787514 2023-02-13 12:03:08,016 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676289787514 from table testCompactionWithHFileLink type FLUSH 2023-02-13 12:03:08,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676289787514 2023-02-13 12:03:08,023 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676289787514' with timeout 300000ms 2023-02-13 12:03:08,023 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 12:03:08,023 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676289787514' starting 'acquire' stage 2023-02-13 12:03:08,023 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676289787514' locally acquired 2023-02-13 12:03:08,023 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (snaptb-1676289787514) in zk 2023-02-13 12:03:08,034 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676289787514 2023-02-13 12:03:08,034 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 12:03:08,034 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676289787514 2023-02-13 12:03:08,034 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676289787514' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:08,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:08,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:08,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676289787514 2023-02-13 12:03:08,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:08,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'snaptb-1676289787514' on coordinator 2023-02-13 12:03:08,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45a68a1a[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:08,037 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676289787514' starting 'in-barrier' execution. 2023-02-13 12:03:08,037 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676289787514 2023-02-13 12:03:08,045 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676289787514 2023-02-13 12:03:08,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676289787514 2023-02-13 12:03:08,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676289787514 2023-02-13 12:03:08,045 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676289787514' received 'reached' from coordinator. 2023-02-13 12:03:08,045 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,045 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:08,046 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:08,047 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:08,047 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-13 12:03:08,047 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:08,047 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 12:03:08,047 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. started... 2023-02-13 12:03:08,047 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. started... 2023-02-13 12:03:08,047 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. started... 2023-02-13 12:03:08,047 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:08,047 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:08,047 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:08,049 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.' region-info for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,049 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.' region-info for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,049 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.' region-info for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,168 INFO [regionserver/jenkins-hbase16:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-13 12:03:08,170 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 12:03:08,170 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 12:03:08,170 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 12:03:08,173 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/0a5a394bf83a414f988e525d1d5a439e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/8eca9b704694444cb85cfd0aaf3c767d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/7e203aee01d64da7b4116873e4b7d4c0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/f845fb56af5347828fe5d72c0005c3d9] hfiles 2023-02-13 12:03:08,173 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/bdac2c2855f842bc8fdce950c6a4d20d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/118d505c73fe491eb7a1f5597b9456cc, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/ff70dcab71974ee689c282bdf9b306a1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/fc011753471f43d0899fbce127326f77] hfiles 2023-02-13 12:03:08,173 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/0a5a394bf83a414f988e525d1d5a439e for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,173 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/d146e457d6fd468698e71119ef297d9a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/de8f86d8ef124e78aa4321759f9ba242, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/a6f1a4a79535415a8c4f22ca595118b5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/7c65a056477b4ceebcc6ce4d80280b8f] hfiles 2023-02-13 12:03:08,173 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/bdac2c2855f842bc8fdce950c6a4d20d for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,173 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/d146e457d6fd468698e71119ef297d9a for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/de8f86d8ef124e78aa4321759f9ba242 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/a6f1a4a79535415a8c4f22ca595118b5 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/7c65a056477b4ceebcc6ce4d80280b8f for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/8eca9b704694444cb85cfd0aaf3c767d for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/118d505c73fe491eb7a1f5597b9456cc for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/7e203aee01d64da7b4116873e4b7d4c0 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/f845fb56af5347828fe5d72c0005c3d9 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/f2f764658363435985293fad4ef281a8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/12cce83299ed46d696cb3dd95fd7e722, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/2329f066e769429ea9b15082dda45516, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/25e90067726942538cadd24fec06682c] hfiles 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/f2f764658363435985293fad4ef281a8 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/e94601520c5647d6a976976240480ed1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ee8387d608124fe09f646c11760c909e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/d58fda5c28374897bf0e579a35d076e2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ecd6814835be4497af4559cb933cb9f4] hfiles 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/e94601520c5647d6a976976240480ed1 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ee8387d608124fe09f646c11760c909e for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/12cce83299ed46d696cb3dd95fd7e722 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/ff70dcab71974ee689c282bdf9b306a1 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/2329f066e769429ea9b15082dda45516 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/25e90067726942538cadd24fec06682c for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/d58fda5c28374897bf0e579a35d076e2 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/fc011753471f43d0899fbce127326f77 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ecd6814835be4497af4559cb933cb9f4 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/1bafa769e7c84ad286b828002b2e166a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/6d98e29bb13446f78e6aace4e2d6e5ff, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/d9ca5e447a8a4a818bb6d80d89f5a04b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/5cc8e607d31e4ac8b676cba70b765713] hfiles 2023-02-13 12:03:08,176 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/1bafa769e7c84ad286b828002b2e166a for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,177 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/6d98e29bb13446f78e6aace4e2d6e5ff for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,177 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/d9ca5e447a8a4a818bb6d80d89f5a04b for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,177 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/5cc8e607d31e4ac8b676cba70b765713 for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,181 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:08,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:08,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 12:03:08,182 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 12:03:08,584 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. completed. 2023-02-13 12:03:08,584 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:08,584 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. completed. 2023-02-13 12:03:08,585 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:08,586 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-13 12:03:08,586 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. completed. 2023-02-13 12:03:08,586 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:08,586 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-13 12:03:08,587 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-13 12:03:08,587 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-13 12:03:08,587 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,587 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676289787514' locally completed 2023-02-13 12:03:08,587 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676289787514' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:08,595 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,595 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676289787514' has notified controller of completion 2023-02-13 12:03:08,595 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 12:03:08,595 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676289787514' completed. 2023-02-13 12:03:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676289787514 2023-02-13 12:03:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:08,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676289787514 2023-02-13 12:03:08,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676289787514' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:08,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'snaptb-1676289787514', counting down latch. Waiting for 0 more 2023-02-13 12:03:08,602 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676289787514' execution completed 2023-02-13 12:03:08,602 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:08,602 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:08,602 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676289787514 2023-02-13 12:03:08,603 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676289787514including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 12:03:08,611 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676289787514 2023-02-13 12:03:08,611 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676289787514 2023-02-13 12:03:08,612 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 12:03:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676289787514 2023-02-13 12:03:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 12:03:08,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676289787514 2023-02-13 12:03:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676289787514 2023-02-13 12:03:08,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:08,613 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 12:03:08,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 12:03:08,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676289787514 2023-02-13 12:03:08,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676289787514 2023-02-13 12:03:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676289787514 2023-02-13 12:03:08,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,617 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:08,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676289787514 2023-02-13 12:03:08,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,628 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 12:03:08,628 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,628 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 12:03:08,628 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676289787514 2023-02-13 12:03:08,628 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:08,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676289787514 2023-02-13 12:03:08,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 12:03:08,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-13 12:03:08,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 12:03:08,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676289787514 2023-02-13 12:03:08,628 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676289787514 2023-02-13 12:03:08,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-13 12:03:08,629 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676289787514/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:08,629 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676289787514 2023-02-13 12:03:08,629 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676289787514 2023-02-13 12:03:08,629 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676289787514 2023-02-13 12:03:08,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 12:03:08,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 12:03:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137c4c1fdd91234e5ea6ddbbec92505ea7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021396bfd51cf01c432fa06fd872cc19033c, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139fdff0434e8d4d9d9ba42be4bf419bf7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213cd865ad2381249e5afca9f2669c964e2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302136bc33b7545c84473af738e49243037e7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138b4465b0514c4bb6a0aa8d83b9b3d879, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138baef262e654434da997f58c60408a89, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ef71206b667443b29e87b9b6fe1e58c2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134f6a82906a024172a83b59dcaeabe10f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135708ebc13435471da46c7eeac9836dc0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021359806a53616a4990b523e65a17a0ae8a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213657f9ca972404f96b656baf96bd73fd0] mob files 2023-02-13 12:03:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137c4c1fdd91234e5ea6ddbbec92505ea7 2023-02-13 12:03:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021396bfd51cf01c432fa06fd872cc19033c 2023-02-13 12:03:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139fdff0434e8d4d9d9ba42be4bf419bf7 2023-02-13 12:03:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213cd865ad2381249e5afca9f2669c964e2 2023-02-13 12:03:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302136bc33b7545c84473af738e49243037e7 2023-02-13 12:03:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138b4465b0514c4bb6a0aa8d83b9b3d879 2023-02-13 12:03:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138baef262e654434da997f58c60408a89 2023-02-13 12:03:08,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ef71206b667443b29e87b9b6fe1e58c2 2023-02-13 12:03:08,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134f6a82906a024172a83b59dcaeabe10f 2023-02-13 12:03:08,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135708ebc13435471da46c7eeac9836dc0 2023-02-13 12:03:08,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021359806a53616a4990b523e65a17a0ae8a 2023-02-13 12:03:08,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213657f9ca972404f96b656baf96bd73fd0 2023-02-13 12:03:08,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131b85364a46204b528e754314b164387e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213b707310cdf0244458dad0fa27e8b8663, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c5330500c74f4f538a673a63920e4aa3, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213dbb35e707e2b4fafa7bda838c1192f3b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021328f946d776654d1084dec27e0714e724, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213363fdc6be0e44e9dbec39c1c18bcd5ab, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021379833570038e4147a73e6e9c9f74ed32, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f9fdff73d366477996c13a082e1918cb, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213360a9bb926744265bf23c5f27c907a0e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021347fe77417f1442009613b2ffb80665ec, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302136b751d73b976469da3e54a28a229bcf6, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302137c5d1cde5e1649b6b34282a81e041268] mob files 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131b85364a46204b528e754314b164387e 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213b707310cdf0244458dad0fa27e8b8663 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c5330500c74f4f538a673a63920e4aa3 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213dbb35e707e2b4fafa7bda838c1192f3b 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021328f946d776654d1084dec27e0714e724 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213363fdc6be0e44e9dbec39c1c18bcd5ab 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021379833570038e4147a73e6e9c9f74ed32 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f9fdff73d366477996c13a082e1918cb 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213360a9bb926744265bf23c5f27c907a0e 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021347fe77417f1442009613b2ffb80665ec 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302136b751d73b976469da3e54a28a229bcf6 2023-02-13 12:03:08,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302137c5d1cde5e1649b6b34282a81e041268 2023-02-13 12:03:08,682 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:08,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:08,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 12:03:08,684 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 12:03:09,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676289787514 2023-02-13 12:03:09,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/.tmp/snaptb-1676289787514 2023-02-13 12:03:09,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/.tmp/snaptb-1676289787514 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/snaptb-1676289787514 2023-02-13 12:03:09,684 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:09,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:09,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 12:03:09,685 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-13 12:03:10,328 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676289787514 of table testCompactionWithHFileLink completed 2023-02-13 12:03:10,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/.tmp/snaptb-1676289787514 2023-02-13 12:03:10,329 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/.tmp/snaptb-1676289787514 2023-02-13 12:03:10,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676289787514 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676289787566Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676289789044 (+1478 ms)Consolidate snapshot: snaptb-1676289787514 at 1676289789044Loading Region manifests for snaptb-1676289787514 at 1676289789044Writing data manifest for snaptb-1676289787514 at 1676289789063 (+19 ms)Verifying snapshot: snaptb-1676289787514 at 1676289789474 (+411 ms)Snapshot snaptb-1676289787514 of table testCompactionWithHFileLink completed at 1676289790328 (+854 ms) 2023-02-13 12:03:10,332 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 12:03:10,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.7650 sec 2023-02-13 12:03:11,685 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:11,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:11,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 12:03:11,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:11,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:11,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 12:03:11,740 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 12:03:11,740 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:11,740 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 12:03:11,740 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 12:03:11,740 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:11,740 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:11,769 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:11,769 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:11,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:11,770 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:11,770 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:11,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:11,771 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 12:03:11,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 12:03:11,772 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 12:03:11,772 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:11,772 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 12:03:11,772 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:11,772 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:03:11,773 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:11,772 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. started... 2023-02-13 12:03:11,772 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:11,773 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. started... 2023-02-13 12:03:11,773 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:11,773 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ee7954bd40bd1dafda1c1f1de68abb8 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 12:03:11,773 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. started... 2023-02-13 12:03:11,773 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1720c79b89223ff190ccb8a9ee0a2e40 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 12:03:11,773 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a6f3edcaac9ede8077d2872e0a533416 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 12:03:12,196 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/2818b4ac5d1647bea0fafbe24df78869 2023-02-13 12:03:12,199 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2818b4ac5d1647bea0fafbe24df78869 2023-02-13 12:03:12,597 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/604b9c44f5d34cf287b9f5196683f8b5 2023-02-13 12:03:12,597 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/c05348e3e0094e859ad43f34973988e9 2023-02-13 12:03:12,607 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 604b9c44f5d34cf287b9f5196683f8b5 2023-02-13 12:03:12,608 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c05348e3e0094e859ad43f34973988e9 2023-02-13 12:03:13,016 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/dd942622e21e4beabc678817637b7b8e 2023-02-13 12:03:13,027 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd942622e21e4beabc678817637b7b8e 2023-02-13 12:03:13,028 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/2818b4ac5d1647bea0fafbe24df78869 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/2818b4ac5d1647bea0fafbe24df78869 2023-02-13 12:03:13,031 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/9adf7b03e5d2460a8e2c44762d620561 2023-02-13 12:03:13,032 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2818b4ac5d1647bea0fafbe24df78869 2023-02-13 12:03:13,033 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/2818b4ac5d1647bea0fafbe24df78869, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 12:03:13,033 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/dd942622e21e4beabc678817637b7b8e as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/dd942622e21e4beabc678817637b7b8e 2023-02-13 12:03:13,034 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9adf7b03e5d2460a8e2c44762d620561 2023-02-13 12:03:13,035 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/c05348e3e0094e859ad43f34973988e9 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/c05348e3e0094e859ad43f34973988e9 2023-02-13 12:03:13,036 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd942622e21e4beabc678817637b7b8e 2023-02-13 12:03:13,037 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/dd942622e21e4beabc678817637b7b8e, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 12:03:13,037 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1720c79b89223ff190ccb8a9ee0a2e40 in 1264ms, sequenceid=24, compaction requested=true 2023-02-13 12:03:13,037 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:13,037 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:13,037 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:13,038 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c05348e3e0094e859ad43f34973988e9 2023-02-13 12:03:13,038 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/c05348e3e0094e859ad43f34973988e9, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 12:03:13,039 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/9adf7b03e5d2460a8e2c44762d620561 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/9adf7b03e5d2460a8e2c44762d620561 2023-02-13 12:03:13,042 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9adf7b03e5d2460a8e2c44762d620561 2023-02-13 12:03:13,042 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/9adf7b03e5d2460a8e2c44762d620561, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 12:03:13,043 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8ee7954bd40bd1dafda1c1f1de68abb8 in 1270ms, sequenceid=24, compaction requested=true 2023-02-13 12:03:13,043 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:13,043 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:13,043 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:13,431 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/00990c9010b34b63b8552b0367bf4d6b 2023-02-13 12:03:13,442 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00990c9010b34b63b8552b0367bf4d6b 2023-02-13 12:03:13,443 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/604b9c44f5d34cf287b9f5196683f8b5 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/604b9c44f5d34cf287b9f5196683f8b5 2023-02-13 12:03:13,449 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 604b9c44f5d34cf287b9f5196683f8b5 2023-02-13 12:03:13,449 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/604b9c44f5d34cf287b9f5196683f8b5, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 12:03:13,451 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/00990c9010b34b63b8552b0367bf4d6b as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/00990c9010b34b63b8552b0367bf4d6b 2023-02-13 12:03:13,456 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00990c9010b34b63b8552b0367bf4d6b 2023-02-13 12:03:13,456 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/00990c9010b34b63b8552b0367bf4d6b, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 12:03:13,457 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a6f3edcaac9ede8077d2872e0a533416 in 1684ms, sequenceid=24, compaction requested=true 2023-02-13 12:03:13,458 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:13,458 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:13,458 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:13,458 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:13,458 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,458 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 12:03:13,458 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 12:03:13,491 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,491 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:13,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:13,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:13,492 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:13,492 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:13,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:13,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:13,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:13,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:13,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 12:03:13,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bd4e74c[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:13,497 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 12:03:13,497 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:13,511 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:13,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:13,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:13,512 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 12:03:13,512 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 12:03:13,512 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:13,512 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,512 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:13,520 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,520 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 12:03:13,520 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:13,520 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 12:03:13,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:13,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:13,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:13,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:13,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 12:03:13,529 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 12:03:13,529 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:13,529 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:13,529 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 12:03:13,529 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:13,536 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:13,536 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:13,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:13,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:13,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:13,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:13,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:13,536 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:13,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:13,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:13,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:13,538 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:13,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:13,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:13,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:13,542 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:13,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 12:03:13,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:13,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:13,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 12:03:13,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:13,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:13,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 12:03:13,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:13,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 12:03:13,553 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:13,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:13,553 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:13,553 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:13,553 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:13,554 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 12:03:13,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:13,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:13,554 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 12:03:13,654 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:13,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:13,657 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:13,657 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 1720c79b89223ff190ccb8a9ee0a2e40/family1 is initiating major compaction (all files) 2023-02-13 12:03:13,658 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:13,658 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:13,658 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 1720c79b89223ff190ccb8a9ee0a2e40/family1 in testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:13,659 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/0a5a394bf83a414f988e525d1d5a439e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/8eca9b704694444cb85cfd0aaf3c767d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/7e203aee01d64da7b4116873e4b7d4c0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/f845fb56af5347828fe5d72c0005c3d9, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/2818b4ac5d1647bea0fafbe24df78869] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp, totalSize=26.7 K 2023-02-13 12:03:13,660 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 0a5a394bf83a414f988e525d1d5a439e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779878 2023-02-13 12:03:13,662 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 8eca9b704694444cb85cfd0aaf3c767d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781791 2023-02-13 12:03:13,663 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 7e203aee01d64da7b4116873e4b7d4c0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783660 2023-02-13 12:03:13,664 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting f845fb56af5347828fe5d72c0005c3d9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:13,665 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 2818b4ac5d1647bea0fafbe24df78869, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 12:03:13,686 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 1720c79b89223ff190ccb8a9ee0a2e40#family1#compaction#108 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:14,096 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213dc9720b2d65145e2a12b6bdb39c38077_del 2023-02-13 12:03:14,097 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213dc9720b2d65145e2a12b6bdb39c38077_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213dc9720b2d65145e2a12b6bdb39c38077_del 2023-02-13 12:03:14,925 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 938434beee3743ed8a602cd89d1d2b4d 2023-02-13 12:03:14,926 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/938434beee3743ed8a602cd89d1d2b4d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/938434beee3743ed8a602cd89d1d2b4d 2023-02-13 12:03:14,931 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 938434beee3743ed8a602cd89d1d2b4d 2023-02-13 12:03:14,932 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1720c79b89223ff190ccb8a9ee0a2e40/family1 of 1720c79b89223ff190ccb8a9ee0a2e40 into 938434beee3743ed8a602cd89d1d2b4d(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:14,932 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:14,933 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:14,933 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 1720c79b89223ff190ccb8a9ee0a2e40/family2 is initiating major compaction (all files) 2023-02-13 12:03:14,933 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:14,933 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:14,933 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 1720c79b89223ff190ccb8a9ee0a2e40/family2 in testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:14,933 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/f2f764658363435985293fad4ef281a8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/12cce83299ed46d696cb3dd95fd7e722, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/2329f066e769429ea9b15082dda45516, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/25e90067726942538cadd24fec06682c, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/dd942622e21e4beabc678817637b7b8e] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp, totalSize=25.4 K 2023-02-13 12:03:14,934 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting f2f764658363435985293fad4ef281a8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779878 2023-02-13 12:03:14,934 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 12cce83299ed46d696cb3dd95fd7e722, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781791 2023-02-13 12:03:14,935 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 2329f066e769429ea9b15082dda45516, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783660 2023-02-13 12:03:14,935 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 25e90067726942538cadd24fec06682c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:14,936 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting dd942622e21e4beabc678817637b7b8e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 12:03:14,946 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 1720c79b89223ff190ccb8a9ee0a2e40#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:14,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/0a5a394bf83a414f988e525d1d5a439e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/8eca9b704694444cb85cfd0aaf3c767d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/7e203aee01d64da7b4116873e4b7d4c0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/f845fb56af5347828fe5d72c0005c3d9, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/2818b4ac5d1647bea0fafbe24df78869] to archive 2023-02-13 12:03:14,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:14,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/0a5a394bf83a414f988e525d1d5a439e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/0a5a394bf83a414f988e525d1d5a439e 2023-02-13 12:03:14,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/8eca9b704694444cb85cfd0aaf3c767d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/8eca9b704694444cb85cfd0aaf3c767d 2023-02-13 12:03:14,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/7e203aee01d64da7b4116873e4b7d4c0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/7e203aee01d64da7b4116873e4b7d4c0 2023-02-13 12:03:14,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/f845fb56af5347828fe5d72c0005c3d9 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/f845fb56af5347828fe5d72c0005c3d9 2023-02-13 12:03:14,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/2818b4ac5d1647bea0fafbe24df78869 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/2818b4ac5d1647bea0fafbe24df78869 2023-02-13 12:03:15,362 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021301ee0e14e3b0480fbd9cfce06286b466_del 2023-02-13 12:03:15,362 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021301ee0e14e3b0480fbd9cfce06286b466_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021301ee0e14e3b0480fbd9cfce06286b466_del 2023-02-13 12:03:16,192 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for acfd9c4be78748239526688cadb08223 2023-02-13 12:03:16,194 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/acfd9c4be78748239526688cadb08223 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/acfd9c4be78748239526688cadb08223 2023-02-13 12:03:16,202 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for acfd9c4be78748239526688cadb08223 2023-02-13 12:03:16,203 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1720c79b89223ff190ccb8a9ee0a2e40/family2 of 1720c79b89223ff190ccb8a9ee0a2e40 into acfd9c4be78748239526688cadb08223(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:16,203 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:16,204 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:16,204 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 8ee7954bd40bd1dafda1c1f1de68abb8/family1 is initiating major compaction (all files) 2023-02-13 12:03:16,204 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:16,204 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:16,204 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 8ee7954bd40bd1dafda1c1f1de68abb8/family1 in testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:16,205 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/bdac2c2855f842bc8fdce950c6a4d20d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/118d505c73fe491eb7a1f5597b9456cc, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/ff70dcab71974ee689c282bdf9b306a1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/fc011753471f43d0899fbce127326f77, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/c05348e3e0094e859ad43f34973988e9] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp, totalSize=26.7 K 2023-02-13 12:03:16,205 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting bdac2c2855f842bc8fdce950c6a4d20d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779878 2023-02-13 12:03:16,206 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 118d505c73fe491eb7a1f5597b9456cc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781791 2023-02-13 12:03:16,206 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting ff70dcab71974ee689c282bdf9b306a1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783659 2023-02-13 12:03:16,207 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting fc011753471f43d0899fbce127326f77, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:16,208 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting c05348e3e0094e859ad43f34973988e9, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 12:03:16,223 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 8ee7954bd40bd1dafda1c1f1de68abb8#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:16,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/f2f764658363435985293fad4ef281a8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/12cce83299ed46d696cb3dd95fd7e722, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/2329f066e769429ea9b15082dda45516, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/25e90067726942538cadd24fec06682c, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/dd942622e21e4beabc678817637b7b8e] to archive 2023-02-13 12:03:16,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:16,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/f2f764658363435985293fad4ef281a8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/f2f764658363435985293fad4ef281a8 2023-02-13 12:03:16,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/12cce83299ed46d696cb3dd95fd7e722 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/12cce83299ed46d696cb3dd95fd7e722 2023-02-13 12:03:16,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/2329f066e769429ea9b15082dda45516 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/2329f066e769429ea9b15082dda45516 2023-02-13 12:03:16,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/25e90067726942538cadd24fec06682c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/25e90067726942538cadd24fec06682c 2023-02-13 12:03:16,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/dd942622e21e4beabc678817637b7b8e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/dd942622e21e4beabc678817637b7b8e 2023-02-13 12:03:16,639 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302136c9fcc60f0754b9a8bd6f0b788074597_del 2023-02-13 12:03:16,640 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302136c9fcc60f0754b9a8bd6f0b788074597_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136c9fcc60f0754b9a8bd6f0b788074597_del 2023-02-13 12:03:17,468 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b316682920b1441793a256fa7d4f007d 2023-02-13 12:03:17,468 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/b316682920b1441793a256fa7d4f007d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/b316682920b1441793a256fa7d4f007d 2023-02-13 12:03:17,473 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b316682920b1441793a256fa7d4f007d 2023-02-13 12:03:17,473 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8ee7954bd40bd1dafda1c1f1de68abb8/family1 of 8ee7954bd40bd1dafda1c1f1de68abb8 into b316682920b1441793a256fa7d4f007d(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:17,474 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:17,474 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:17,474 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 8ee7954bd40bd1dafda1c1f1de68abb8/family2 is initiating major compaction (all files) 2023-02-13 12:03:17,474 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:17,474 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:17,474 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 8ee7954bd40bd1dafda1c1f1de68abb8/family2 in testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:17,474 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/1bafa769e7c84ad286b828002b2e166a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/6d98e29bb13446f78e6aace4e2d6e5ff, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/d9ca5e447a8a4a818bb6d80d89f5a04b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/5cc8e607d31e4ac8b676cba70b765713, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/9adf7b03e5d2460a8e2c44762d620561] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp, totalSize=25.4 K 2023-02-13 12:03:17,475 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 1bafa769e7c84ad286b828002b2e166a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779878 2023-02-13 12:03:17,475 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 6d98e29bb13446f78e6aace4e2d6e5ff, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781791 2023-02-13 12:03:17,476 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting d9ca5e447a8a4a818bb6d80d89f5a04b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783659 2023-02-13 12:03:17,476 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 5cc8e607d31e4ac8b676cba70b765713, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:17,477 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 9adf7b03e5d2460a8e2c44762d620561, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 12:03:17,489 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 8ee7954bd40bd1dafda1c1f1de68abb8#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:17,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/bdac2c2855f842bc8fdce950c6a4d20d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/118d505c73fe491eb7a1f5597b9456cc, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/ff70dcab71974ee689c282bdf9b306a1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/fc011753471f43d0899fbce127326f77, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/c05348e3e0094e859ad43f34973988e9] to archive 2023-02-13 12:03:17,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:17,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/bdac2c2855f842bc8fdce950c6a4d20d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/bdac2c2855f842bc8fdce950c6a4d20d 2023-02-13 12:03:17,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/118d505c73fe491eb7a1f5597b9456cc to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/118d505c73fe491eb7a1f5597b9456cc 2023-02-13 12:03:17,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/ff70dcab71974ee689c282bdf9b306a1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/ff70dcab71974ee689c282bdf9b306a1 2023-02-13 12:03:17,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/fc011753471f43d0899fbce127326f77 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/fc011753471f43d0899fbce127326f77 2023-02-13 12:03:17,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/c05348e3e0094e859ad43f34973988e9 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/c05348e3e0094e859ad43f34973988e9 2023-02-13 12:03:17,906 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302131532a649b39f49a4bde9eb38c4f4c9d9_del 2023-02-13 12:03:17,906 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302131532a649b39f49a4bde9eb38c4f4c9d9_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131532a649b39f49a4bde9eb38c4f4c9d9_del 2023-02-13 12:03:18,739 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f716791d17fb455da2cfbaff20e6cc3a 2023-02-13 12:03:18,740 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/f716791d17fb455da2cfbaff20e6cc3a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/f716791d17fb455da2cfbaff20e6cc3a 2023-02-13 12:03:18,746 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f716791d17fb455da2cfbaff20e6cc3a 2023-02-13 12:03:18,747 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8ee7954bd40bd1dafda1c1f1de68abb8/family2 of 8ee7954bd40bd1dafda1c1f1de68abb8 into f716791d17fb455da2cfbaff20e6cc3a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:18,747 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:18,747 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:18,747 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): a6f3edcaac9ede8077d2872e0a533416/family1 is initiating major compaction (all files) 2023-02-13 12:03:18,748 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:18,748 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:18,748 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of a6f3edcaac9ede8077d2872e0a533416/family1 in testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:18,748 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/d146e457d6fd468698e71119ef297d9a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/de8f86d8ef124e78aa4321759f9ba242, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/a6f1a4a79535415a8c4f22ca595118b5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/7c65a056477b4ceebcc6ce4d80280b8f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/604b9c44f5d34cf287b9f5196683f8b5] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp, totalSize=26.7 K 2023-02-13 12:03:18,749 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting d146e457d6fd468698e71119ef297d9a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779877 2023-02-13 12:03:18,749 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting de8f86d8ef124e78aa4321759f9ba242, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781790 2023-02-13 12:03:18,750 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting a6f1a4a79535415a8c4f22ca595118b5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783658 2023-02-13 12:03:18,750 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 7c65a056477b4ceebcc6ce4d80280b8f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:18,750 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 604b9c44f5d34cf287b9f5196683f8b5, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 12:03:18,766 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): a6f3edcaac9ede8077d2872e0a533416#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:18,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/1bafa769e7c84ad286b828002b2e166a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/6d98e29bb13446f78e6aace4e2d6e5ff, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/d9ca5e447a8a4a818bb6d80d89f5a04b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/5cc8e607d31e4ac8b676cba70b765713, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/9adf7b03e5d2460a8e2c44762d620561] to archive 2023-02-13 12:03:18,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:18,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/1bafa769e7c84ad286b828002b2e166a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/1bafa769e7c84ad286b828002b2e166a 2023-02-13 12:03:18,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/6d98e29bb13446f78e6aace4e2d6e5ff to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/6d98e29bb13446f78e6aace4e2d6e5ff 2023-02-13 12:03:18,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/d9ca5e447a8a4a818bb6d80d89f5a04b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/d9ca5e447a8a4a818bb6d80d89f5a04b 2023-02-13 12:03:18,775 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213880d7d0a4ec044ae9a99de708e131632_del 2023-02-13 12:03:18,776 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213880d7d0a4ec044ae9a99de708e131632_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213880d7d0a4ec044ae9a99de708e131632_del 2023-02-13 12:03:18,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/5cc8e607d31e4ac8b676cba70b765713 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/5cc8e607d31e4ac8b676cba70b765713 2023-02-13 12:03:18,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/9adf7b03e5d2460a8e2c44762d620561 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/9adf7b03e5d2460a8e2c44762d620561 2023-02-13 12:03:19,606 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aacb9a520c884d588b938a2a3abae60c 2023-02-13 12:03:19,607 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/aacb9a520c884d588b938a2a3abae60c as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/aacb9a520c884d588b938a2a3abae60c 2023-02-13 12:03:19,612 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aacb9a520c884d588b938a2a3abae60c 2023-02-13 12:03:19,613 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a6f3edcaac9ede8077d2872e0a533416/family1 of a6f3edcaac9ede8077d2872e0a533416 into aacb9a520c884d588b938a2a3abae60c(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:03:19,613 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:19,613 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:19,613 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): a6f3edcaac9ede8077d2872e0a533416/family2 is initiating major compaction (all files) 2023-02-13 12:03:19,613 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:19,613 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:19,613 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of a6f3edcaac9ede8077d2872e0a533416/family2 in testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:19,614 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/e94601520c5647d6a976976240480ed1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ee8387d608124fe09f646c11760c909e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/d58fda5c28374897bf0e579a35d076e2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ecd6814835be4497af4559cb933cb9f4, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/00990c9010b34b63b8552b0367bf4d6b] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp, totalSize=25.4 K 2023-02-13 12:03:19,614 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting e94601520c5647d6a976976240480ed1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779877 2023-02-13 12:03:19,615 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting ee8387d608124fe09f646c11760c909e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781790 2023-02-13 12:03:19,615 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting d58fda5c28374897bf0e579a35d076e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783658 2023-02-13 12:03:19,616 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting ecd6814835be4497af4559cb933cb9f4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:19,616 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 00990c9010b34b63b8552b0367bf4d6b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 12:03:19,626 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): a6f3edcaac9ede8077d2872e0a533416#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:19,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/d146e457d6fd468698e71119ef297d9a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/de8f86d8ef124e78aa4321759f9ba242, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/a6f1a4a79535415a8c4f22ca595118b5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/7c65a056477b4ceebcc6ce4d80280b8f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/604b9c44f5d34cf287b9f5196683f8b5] to archive 2023-02-13 12:03:19,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:19,674 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/d146e457d6fd468698e71119ef297d9a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/d146e457d6fd468698e71119ef297d9a 2023-02-13 12:03:19,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/de8f86d8ef124e78aa4321759f9ba242 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/de8f86d8ef124e78aa4321759f9ba242 2023-02-13 12:03:19,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/a6f1a4a79535415a8c4f22ca595118b5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/a6f1a4a79535415a8c4f22ca595118b5 2023-02-13 12:03:19,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/7c65a056477b4ceebcc6ce4d80280b8f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/7c65a056477b4ceebcc6ce4d80280b8f 2023-02-13 12:03:19,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/604b9c44f5d34cf287b9f5196683f8b5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/604b9c44f5d34cf287b9f5196683f8b5 2023-02-13 12:03:20,044 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213cecfe0a8f4e1400080d6913b1ec317c9_del 2023-02-13 12:03:20,044 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213cecfe0a8f4e1400080d6913b1ec317c9_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213cecfe0a8f4e1400080d6913b1ec317c9_del 2023-02-13 12:03:20,872 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7bf33bbed3ce4e4fa759deaf2237d965 2023-02-13 12:03:20,873 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/7bf33bbed3ce4e4fa759deaf2237d965 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/7bf33bbed3ce4e4fa759deaf2237d965 2023-02-13 12:03:20,879 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7bf33bbed3ce4e4fa759deaf2237d965 2023-02-13 12:03:20,880 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a6f3edcaac9ede8077d2872e0a533416/family2 of a6f3edcaac9ede8077d2872e0a533416 into 7bf33bbed3ce4e4fa759deaf2237d965(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:20,880 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:20,886 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:20,891 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:20,899 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:20,900 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:20,907 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 12:03:20,937 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 12:03:20,940 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213880d7d0a4ec044ae9a99de708e131632_del 2023-02-13 12:03:20,943 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302136c9fcc60f0754b9a8bd6f0b788074597_del 2023-02-13 12:03:20,945 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213dc9720b2d65145e2a12b6bdb39c38077_del 2023-02-13 12:03:20,946 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:20,946 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ReadOnlyZKClient(139): Connect 0x157eede3 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:03:20,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/e94601520c5647d6a976976240480ed1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ee8387d608124fe09f646c11760c909e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/d58fda5c28374897bf0e579a35d076e2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ecd6814835be4497af4559cb933cb9f4, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/00990c9010b34b63b8552b0367bf4d6b] to archive 2023-02-13 12:03:20,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:20,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/e94601520c5647d6a976976240480ed1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/e94601520c5647d6a976976240480ed1 2023-02-13 12:03:20,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ee8387d608124fe09f646c11760c909e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ee8387d608124fe09f646c11760c909e 2023-02-13 12:03:20,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/d58fda5c28374897bf0e579a35d076e2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/d58fda5c28374897bf0e579a35d076e2 2023-02-13 12:03:20,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ecd6814835be4497af4559cb933cb9f4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/ecd6814835be4497af4559cb933cb9f4 2023-02-13 12:03:20,978 DEBUG [Listener at localhost.localdomain/40603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6762c843, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:03:20,979 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:20,979 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:20,979 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:20,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/00990c9010b34b63b8552b0367bf4d6b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/00990c9010b34b63b8552b0367bf4d6b 2023-02-13 12:03:21,440 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302130b3675b0f78247baa2a74fe2d857697b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130b3675b0f78247baa2a74fe2d857697b 2023-02-13 12:03:21,441 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:21,451 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:03:21,455 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49292, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:03:21,461 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:03:21,463 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:03:21,473 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/f528cdcbe44549a7a8c21386011f80d9 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 12:03:21,474 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/f528cdcbe44549a7a8c21386011f80d9}] 2023-02-13 12:03:21,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/f528cdcbe44549a7a8c21386011f80d9 for inclusion in 1720c79b89223ff190ccb8a9ee0a2e40/family1 2023-02-13 12:03:21,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 12:03:21,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 12:03:21,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:21,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/f528cdcbe44549a7a8c21386011f80d9 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__hf9clu7k7cocs5kc71jvchp8eq2mopqet8ufo4kg02o4q8g6kvc2o5clr97s2ef7/family1/f528cdcbe44549a7a8c21386011f80d9 2023-02-13 12:03:21,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__hf9clu7k7cocs5kc71jvchp8eq2mopqet8ufo4kg02o4q8g6kvc2o5clr97s2ef7/family1/f528cdcbe44549a7a8c21386011f80d9 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/a21645d2a14c422c90a512a54816ff1c_SeqId_29_ 2023-02-13 12:03:21,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__hf9clu7k7cocs5kc71jvchp8eq2mopqet8ufo4kg02o4q8g6kvc2o5clr97s2ef7/family1/f528cdcbe44549a7a8c21386011f80d9 into 1720c79b89223ff190ccb8a9ee0a2e40/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/a21645d2a14c422c90a512a54816ff1c_SeqId_29_ - updating store file list. 2023-02-13 12:03:21,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/a21645d2a14c422c90a512a54816ff1c_SeqId_29_ into 1720c79b89223ff190ccb8a9ee0a2e40/family1 2023-02-13 12:03:21,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__hf9clu7k7cocs5kc71jvchp8eq2mopqet8ufo4kg02o4q8g6kvc2o5clr97s2ef7/family1/f528cdcbe44549a7a8c21386011f80d9 into 1720c79b89223ff190ccb8a9ee0a2e40/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/a21645d2a14c422c90a512a54816ff1c_SeqId_29_) 2023-02-13 12:03:21,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__hf9clu7k7cocs5kc71jvchp8eq2mopqet8ufo4kg02o4q8g6kvc2o5clr97s2ef7/family1/f528cdcbe44549a7a8c21386011f80d9 2023-02-13 12:03:21,498 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:21,499 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:21,501 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302136bc33b7545c84473af738e49243037e7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302136bc33b7545c84473af738e49243037e7 2023-02-13 12:03:21,502 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138b4465b0514c4bb6a0aa8d83b9b3d879 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138b4465b0514c4bb6a0aa8d83b9b3d879 2023-02-13 12:03:21,504 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138baef262e654434da997f58c60408a89 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138baef262e654434da997f58c60408a89 2023-02-13 12:03:21,505 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ef71206b667443b29e87b9b6fe1e58c2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ef71206b667443b29e87b9b6fe1e58c2 2023-02-13 12:03:21,505 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 12:03:21,505 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 12:03:21,506 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:21,848 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021377395f7ee47a4a429e073f24e00fd2fe to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021377395f7ee47a4a429e073f24e00fd2fe 2023-02-13 12:03:21,848 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213b4aad8809eef487eb81c747cc413097e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b4aad8809eef487eb81c747cc413097e 2023-02-13 12:03:21,849 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:21,849 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:21,878 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/13838926199045419f21603beba29bab first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 12:03:21,878 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/fb7f05f5eb174f4ba37fc6d0fba934fe first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 12:03:21,880 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/13838926199045419f21603beba29bab}] 2023-02-13 12:03:21,880 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/fb7f05f5eb174f4ba37fc6d0fba934fe}] 2023-02-13 12:03:21,883 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/13838926199045419f21603beba29bab for inclusion in 8ee7954bd40bd1dafda1c1f1de68abb8/family1 2023-02-13 12:03:21,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/fb7f05f5eb174f4ba37fc6d0fba934fe for inclusion in a6f3edcaac9ede8077d2872e0a533416/family1 2023-02-13 12:03:21,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 12:03:21,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 12:03:21,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 12:03:21,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 12:03:21,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:21,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:21,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/fb7f05f5eb174f4ba37fc6d0fba934fe to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__ibeqcg7edeu22rfvddjqhuj47s305cahg9hvm9bolgts9ecaeegpfhhjbvjvf5ac/family1/fb7f05f5eb174f4ba37fc6d0fba934fe 2023-02-13 12:03:21,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/13838926199045419f21603beba29bab to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__mlol6ib5o8a3tem63t26394cv0mihk02ne8f4j91i6o45ig8aqqcuivllvdc37s6/family1/13838926199045419f21603beba29bab 2023-02-13 12:03:21,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__ibeqcg7edeu22rfvddjqhuj47s305cahg9hvm9bolgts9ecaeegpfhhjbvjvf5ac/family1/fb7f05f5eb174f4ba37fc6d0fba934fe as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/e66e2146dae64575be37ae19a2558425_SeqId_29_ 2023-02-13 12:03:21,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__mlol6ib5o8a3tem63t26394cv0mihk02ne8f4j91i6o45ig8aqqcuivllvdc37s6/family1/13838926199045419f21603beba29bab as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/16aaab2a588a4ce58b5edada42e5b9cd_SeqId_29_ 2023-02-13 12:03:21,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__ibeqcg7edeu22rfvddjqhuj47s305cahg9hvm9bolgts9ecaeegpfhhjbvjvf5ac/family1/fb7f05f5eb174f4ba37fc6d0fba934fe into a6f3edcaac9ede8077d2872e0a533416/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/e66e2146dae64575be37ae19a2558425_SeqId_29_ - updating store file list. 2023-02-13 12:03:21,891 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__mlol6ib5o8a3tem63t26394cv0mihk02ne8f4j91i6o45ig8aqqcuivllvdc37s6/family1/13838926199045419f21603beba29bab into 8ee7954bd40bd1dafda1c1f1de68abb8/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/16aaab2a588a4ce58b5edada42e5b9cd_SeqId_29_ - updating store file list. 2023-02-13 12:03:21,894 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/16aaab2a588a4ce58b5edada42e5b9cd_SeqId_29_ into 8ee7954bd40bd1dafda1c1f1de68abb8/family1 2023-02-13 12:03:21,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/e66e2146dae64575be37ae19a2558425_SeqId_29_ into a6f3edcaac9ede8077d2872e0a533416/family1 2023-02-13 12:03:21,894 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__mlol6ib5o8a3tem63t26394cv0mihk02ne8f4j91i6o45ig8aqqcuivllvdc37s6/family1/13838926199045419f21603beba29bab into 8ee7954bd40bd1dafda1c1f1de68abb8/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/16aaab2a588a4ce58b5edada42e5b9cd_SeqId_29_) 2023-02-13 12:03:21,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__ibeqcg7edeu22rfvddjqhuj47s305cahg9hvm9bolgts9ecaeegpfhhjbvjvf5ac/family1/fb7f05f5eb174f4ba37fc6d0fba934fe into a6f3edcaac9ede8077d2872e0a533416/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/e66e2146dae64575be37ae19a2558425_SeqId_29_) 2023-02-13 12:03:21,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__mlol6ib5o8a3tem63t26394cv0mihk02ne8f4j91i6o45ig8aqqcuivllvdc37s6/family1/13838926199045419f21603beba29bab 2023-02-13 12:03:21,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__ibeqcg7edeu22rfvddjqhuj47s305cahg9hvm9bolgts9ecaeegpfhhjbvjvf5ac/family1/fb7f05f5eb174f4ba37fc6d0fba934fe 2023-02-13 12:03:21,896 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:21,896 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:21,896 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:21,897 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:21,898 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137c4c1fdd91234e5ea6ddbbec92505ea7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137c4c1fdd91234e5ea6ddbbec92505ea7 2023-02-13 12:03:21,898 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134f6a82906a024172a83b59dcaeabe10f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134f6a82906a024172a83b59dcaeabe10f 2023-02-13 12:03:21,898 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021396bfd51cf01c432fa06fd872cc19033c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021396bfd51cf01c432fa06fd872cc19033c 2023-02-13 12:03:21,898 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135708ebc13435471da46c7eeac9836dc0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302135708ebc13435471da46c7eeac9836dc0 2023-02-13 12:03:21,899 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139fdff0434e8d4d9d9ba42be4bf419bf7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139fdff0434e8d4d9d9ba42be4bf419bf7 2023-02-13 12:03:21,899 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021359806a53616a4990b523e65a17a0ae8a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021359806a53616a4990b523e65a17a0ae8a 2023-02-13 12:03:21,900 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213cd865ad2381249e5afca9f2669c964e2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213cd865ad2381249e5afca9f2669c964e2 2023-02-13 12:03:21,900 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213657f9ca972404f96b656baf96bd73fd0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213657f9ca972404f96b656baf96bd73fd0 2023-02-13 12:03:21,900 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 12:03:21,900 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 12:03:21,900 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 12:03:21,900 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 12:03:21,901 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:21,901 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:21,901 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:21,901 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:21,901 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213880d7d0a4ec044ae9a99de708e131632_del] 2023-02-13 12:03:21,901 DEBUG [Listener at localhost.localdomain/40603] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:21,902 DEBUG [Listener at localhost.localdomain/40603] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213880d7d0a4ec044ae9a99de708e131632_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213880d7d0a4ec044ae9a99de708e131632_del 2023-02-13 12:03:21,902 INFO [Listener at localhost.localdomain/40603] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 12:03:21,902 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136c9fcc60f0754b9a8bd6f0b788074597_del] 2023-02-13 12:03:21,903 DEBUG [Listener at localhost.localdomain/40603] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:21,904 DEBUG [Listener at localhost.localdomain/40603] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136c9fcc60f0754b9a8bd6f0b788074597_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136c9fcc60f0754b9a8bd6f0b788074597_del 2023-02-13 12:03:21,904 INFO [Listener at localhost.localdomain/40603] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 12:03:21,904 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213dc9720b2d65145e2a12b6bdb39c38077_del] 2023-02-13 12:03:21,904 DEBUG [Listener at localhost.localdomain/40603] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:21,905 DEBUG [Listener at localhost.localdomain/40603] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213dc9720b2d65145e2a12b6bdb39c38077_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213dc9720b2d65145e2a12b6bdb39c38077_del 2023-02-13 12:03:21,905 INFO [Listener at localhost.localdomain/40603] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 12:03:21,908 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:21,910 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:21,914 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:21,915 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:21,921 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-13 12:03:21,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$11(2405): Client=jenkins//188.40.62.62 disable testCompactionWithHFileLink 2023-02-13 12:03:21,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-13 12:03:21,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 12:03:21,924 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289801924"}]},"ts":"1676289801924"} 2023-02-13 12:03:21,925 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-13 12:03:21,952 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-13 12:03:21,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, UNASSIGN}] 2023-02-13 12:03:21,955 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, UNASSIGN 2023-02-13 12:03:21,955 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, UNASSIGN 2023-02-13 12:03:21,955 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, UNASSIGN 2023-02-13 12:03:21,955 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=8ee7954bd40bd1dafda1c1f1de68abb8, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:21,955 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=a6f3edcaac9ede8077d2872e0a533416, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:21,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1720c79b89223ff190ccb8a9ee0a2e40, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:21,955 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289801955"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289801955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289801955"}]},"ts":"1676289801955"} 2023-02-13 12:03:21,955 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289801955"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289801955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289801955"}]},"ts":"1676289801955"} 2023-02-13 12:03:21,955 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289801955"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289801955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289801955"}]},"ts":"1676289801955"} 2023-02-13 12:03:21,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure 1720c79b89223ff190ccb8a9ee0a2e40, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:21,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure a6f3edcaac9ede8077d2872e0a533416, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:21,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 8ee7954bd40bd1dafda1c1f1de68abb8, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:22,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 12:03:22,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:22,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 8ee7954bd40bd1dafda1c1f1de68abb8, disabling compactions & flushes 2023-02-13 12:03:22,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:22,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:22,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. after waiting 0 ms 2023-02-13 12:03:22,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:22,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 12:03:22,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:22,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 8ee7954bd40bd1dafda1c1f1de68abb8: Waiting for close lock at 1676289802109Running coprocessor pre-close hooks at 1676289802109Disabling compacts and flushes for region at 1676289802109Disabling writes for close at 1676289802110 (+1 ms)Writing region close event to WAL at 1676289802112 (+2 ms)Running coprocessor post-close hooks at 1676289802120 (+8 ms)Closed at 1676289802121 (+1 ms) 2023-02-13 12:03:22,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:22,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:22,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing a6f3edcaac9ede8077d2872e0a533416, disabling compactions & flushes 2023-02-13 12:03:22,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:22,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:22,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. after waiting 0 ms 2023-02-13 12:03:22,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:22,125 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=8ee7954bd40bd1dafda1c1f1de68abb8, regionState=CLOSED 2023-02-13 12:03:22,126 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289802125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289802125"}]},"ts":"1676289802125"} 2023-02-13 12:03:22,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=90 2023-02-13 12:03:22,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 8ee7954bd40bd1dafda1c1f1de68abb8, server=jenkins-hbase16.apache.org,39857,1676289663697 in 169 msec 2023-02-13 12:03:22,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, UNASSIGN in 177 msec 2023-02-13 12:03:22,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 12:03:22,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:22,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for a6f3edcaac9ede8077d2872e0a533416: Waiting for close lock at 1676289802125Running coprocessor pre-close hooks at 1676289802125Disabling compacts and flushes for region at 1676289802125Disabling writes for close at 1676289802125Writing region close event to WAL at 1676289802127 (+2 ms)Running coprocessor post-close hooks at 1676289802133 (+6 ms)Closed at 1676289802134 (+1 ms) 2023-02-13 12:03:22,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:22,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(109): Close 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:22,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 1720c79b89223ff190ccb8a9ee0a2e40, disabling compactions & flushes 2023-02-13 12:03:22,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:22,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:22,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. after waiting 0 ms 2023-02-13 12:03:22,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:22,136 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=a6f3edcaac9ede8077d2872e0a533416, regionState=CLOSED 2023-02-13 12:03:22,136 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289802136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289802136"}]},"ts":"1676289802136"} 2023-02-13 12:03:22,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-02-13 12:03:22,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure a6f3edcaac9ede8077d2872e0a533416, server=jenkins-hbase16.apache.org,39857,1676289663697 in 180 msec 2023-02-13 12:03:22,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, UNASSIGN in 186 msec 2023-02-13 12:03:22,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 12:03:22,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:22,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 1720c79b89223ff190ccb8a9ee0a2e40: Waiting for close lock at 1676289802136Running coprocessor pre-close hooks at 1676289802136Disabling compacts and flushes for region at 1676289802136Disabling writes for close at 1676289802136Writing region close event to WAL at 1676289802137 (+1 ms)Running coprocessor post-close hooks at 1676289802141 (+4 ms)Closed at 1676289802141 2023-02-13 12:03:22,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(147): Closed 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:22,143 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1720c79b89223ff190ccb8a9ee0a2e40, regionState=CLOSED 2023-02-13 12:03:22,143 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289802143"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289802143"}]},"ts":"1676289802143"} 2023-02-13 12:03:22,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-02-13 12:03:22,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure 1720c79b89223ff190ccb8a9ee0a2e40, server=jenkins-hbase16.apache.org,39857,1676289663697 in 188 msec 2023-02-13 12:03:22,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=88 2023-02-13 12:03:22,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, UNASSIGN in 193 msec 2023-02-13 12:03:22,148 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289802148"}]},"ts":"1676289802148"} 2023-02-13 12:03:22,149 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-13 12:03:22,159 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-13 12:03:22,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 238 msec 2023-02-13 12:03:22,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 12:03:22,228 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-13 12:03:22,245 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676289787514-1676289802245 2023-02-13 12:03:22,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1580): Client=jenkins//188.40.62.62 snapshot request for:{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 12:03:22,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676289802246 (current time:1676289802246). 2023-02-13 12:03:22,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 12:03:22,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] zookeeper.ReadOnlyZKClient(139): Connect 0x0e59a133 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:03:22,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a780f8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:03:22,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:03:22,262 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49306, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:03:22,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e59a133 to 127.0.0.1:62284 2023-02-13 12:03:22,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:03:22,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 12:03:22,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 12:03:22,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 12:03:22,267 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 12:03:22,268 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676290402268 2023-02-13 12:03:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 12:03:22,268 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676289787514-1676289802245 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 12:03:22,268 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:22,268 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 12:03:22,368 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:22,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:22,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 12:03:22,373 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 12:03:22,574 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:22,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:22,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 12:03:22,577 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 12:03:22,679 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-13 12:03:22,682 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 12:03:22,682 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 12:03:22,682 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 12:03:22,682 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 12:03:22,682 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 12:03:22,683 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 12:03:22,682 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 12:03:22,682 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 12:03:22,686 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/aacb9a520c884d588b938a2a3abae60c, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/e66e2146dae64575be37ae19a2558425_SeqId_29_] hfiles 2023-02-13 12:03:22,686 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/938434beee3743ed8a602cd89d1d2b4d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/a21645d2a14c422c90a512a54816ff1c_SeqId_29_] hfiles 2023-02-13 12:03:22,686 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/aacb9a520c884d588b938a2a3abae60c 2023-02-13 12:03:22,686 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/16aaab2a588a4ce58b5edada42e5b9cd_SeqId_29_, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/b316682920b1441793a256fa7d4f007d] hfiles 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/e66e2146dae64575be37ae19a2558425_SeqId_29_ 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b4aad8809eef487eb81c747cc413097e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130b3675b0f78247baa2a74fe2d857697b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021377395f7ee47a4a429e073f24e00fd2fe] hfiles 2023-02-13 12:03:22,686 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/938434beee3743ed8a602cd89d1d2b4d 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b4aad8809eef487eb81c747cc413097e 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/16aaab2a588a4ce58b5edada42e5b9cd_SeqId_29_ 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130b3675b0f78247baa2a74fe2d857697b 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/a21645d2a14c422c90a512a54816ff1c_SeqId_29_ 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021377395f7ee47a4a429e073f24e00fd2fe 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/b316682920b1441793a256fa7d4f007d 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/7bf33bbed3ce4e4fa759deaf2237d965] hfiles 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/7bf33bbed3ce4e4fa759deaf2237d965 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/acfd9c4be78748239526688cadb08223] hfiles 2023-02-13 12:03:22,687 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/acfd9c4be78748239526688cadb08223 2023-02-13 12:03:22,688 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/f716791d17fb455da2cfbaff20e6cc3a] hfiles 2023-02-13 12:03:22,688 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/f716791d17fb455da2cfbaff20e6cc3a 2023-02-13 12:03:22,694 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131532a649b39f49a4bde9eb38c4f4c9d9_del, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131b85364a46204b528e754314b164387e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213b707310cdf0244458dad0fa27e8b8663, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c5330500c74f4f538a673a63920e4aa3, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213dbb35e707e2b4fafa7bda838c1192f3b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021301ee0e14e3b0480fbd9cfce06286b466_del, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021328f946d776654d1084dec27e0714e724, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213363fdc6be0e44e9dbec39c1c18bcd5ab, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021379833570038e4147a73e6e9c9f74ed32, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f9fdff73d366477996c13a082e1918cb, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213360a9bb926744265bf23c5f27c907a0e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021347fe77417f1442009613b2ffb80665ec, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302136b751d73b976469da3e54a28a229bcf6, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302137c5d1cde5e1649b6b34282a81e041268, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213cecfe0a8f4e1400080d6913b1ec317c9_del] hfiles 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131532a649b39f49a4bde9eb38c4f4c9d9_del 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131b85364a46204b528e754314b164387e 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213b707310cdf0244458dad0fa27e8b8663 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213c5330500c74f4f538a673a63920e4aa3 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213dbb35e707e2b4fafa7bda838c1192f3b 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021301ee0e14e3b0480fbd9cfce06286b466_del 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021328f946d776654d1084dec27e0714e724 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213363fdc6be0e44e9dbec39c1c18bcd5ab 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021379833570038e4147a73e6e9c9f74ed32 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213f9fdff73d366477996c13a082e1918cb 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213360a9bb926744265bf23c5f27c907a0e 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021347fe77417f1442009613b2ffb80665ec 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302136b751d73b976469da3e54a28a229bcf6 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302137c5d1cde5e1649b6b34282a81e041268 2023-02-13 12:03:22,695 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213cecfe0a8f4e1400080d6913b1ec317c9_del 2023-02-13 12:03:22,877 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:22,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:22,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 12:03:22,880 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 12:03:23,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-13 12:03:23,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676289787514-1676289802245 2023-02-13 12:03:23,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676289787514-1676289802245 2023-02-13 12:03:23,380 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:23,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:23,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 12:03:23,383 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 12:03:23,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676289787514-1676289802245 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/hbase-failsafe-snaptb-1676289787514-1676289802245 2023-02-13 12:03:24,380 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676289787514-1676289802245 of table testCompactionWithHFileLink completed 2023-02-13 12:03:24,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676289787514-1676289802245 2023-02-13 12:03:24,382 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676289787514-1676289802245 2023-02-13 12:03:24,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676289787514-1676289802245 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676289802268Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676289802679 (+411 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676289787514-1676289802245 at 1676289803100 (+421 ms)Loading Region manifests for hbase-failsafe-snaptb-1676289787514-1676289802245 at 1676289803100Writing data manifest for hbase-failsafe-snaptb-1676289787514-1676289802245 at 1676289803108 (+8 ms)Verifying snapshot: hbase-failsafe-snaptb-1676289787514-1676289802245 at 1676289803539 (+431 ms)Snapshot hbase-failsafe-snaptb-1676289787514-1676289802245 of table testCompactionWithHFileLink completed at 1676289804380 (+841 ms) 2023-02-13 12:03:24,383 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 12:03:24,385 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 12:03:24,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 12:03:24,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676289787514-1676289802245 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 12:03:24,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.1190 sec 2023-02-13 12:03:24,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676289787514" table: "testCompactionWithHFileLink" creation_time: 1676289787528 type: FLUSH version: 2 ttl: 0 ) 2023-02-13 12:03:24,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676289787514 as table=testCompactionWithHFileLink 2023-02-13 12:03:24,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 12:03:24,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 12:03:24,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 12:03:24,844 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 12:03:24,847 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 12:03:24,847 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 12:03:24,849 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 12:03:24,861 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676289787514" table: "testCompactionWithHFileLink" creation_time: 1676289787528 type: FLUSH version: 2 ttl: 0 2023-02-13 12:03:24,863 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink 2023-02-13 12:03:24,867 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-13 12:03:24,871 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b4aad8809eef487eb81c747cc413097e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b4aad8809eef487eb81c747cc413097e 2023-02-13 12:03:24,872 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021377395f7ee47a4a429e073f24e00fd2fe to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021377395f7ee47a4a429e073f24e00fd2fe 2023-02-13 12:03:24,874 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130b3675b0f78247baa2a74fe2d857697b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130b3675b0f78247baa2a74fe2d857697b 2023-02-13 12:03:24,874 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302137c4c1fdd91234e5ea6ddbbec92505ea7 of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,878 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023021396bfd51cf01c432fa06fd872cc19033c of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,881 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302139fdff0434e8d4d9d9ba42be4bf419bf7 of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,883 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213cd865ad2381249e5afca9f2669c964e2 of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,885 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302136bc33b7545c84473af738e49243037e7 of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,887 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302138b4465b0514c4bb6a0aa8d83b9b3d879 of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,890 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302138baef262e654434da997f58c60408a89 of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,892 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230213ef71206b667443b29e87b9b6fe1e58c2 of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,894 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302134f6a82906a024172a83b59dcaeabe10f of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,897 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302135708ebc13435471da46c7eeac9836dc0 of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,900 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023021359806a53616a4990b523e65a17a0ae8a of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,903 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213657f9ca972404f96b656baf96bd73fd0 of snapshot=snaptb-1676289787514 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 12:03:24,908 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213cecfe0a8f4e1400080d6913b1ec317c9_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213cecfe0a8f4e1400080d6913b1ec317c9_del 2023-02-13 12:03:24,909 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131532a649b39f49a4bde9eb38c4f4c9d9_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302131532a649b39f49a4bde9eb38c4f4c9d9_del 2023-02-13 12:03:24,910 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021301ee0e14e3b0480fbd9cfce06286b466_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021301ee0e14e3b0480fbd9cfce06286b466_del 2023-02-13 12:03:24,910 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:24,911 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:24,911 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:24,918 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/938434beee3743ed8a602cd89d1d2b4d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/938434beee3743ed8a602cd89d1d2b4d 2023-02-13 12:03:24,918 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/16aaab2a588a4ce58b5edada42e5b9cd_SeqId_29_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/16aaab2a588a4ce58b5edada42e5b9cd_SeqId_29_ 2023-02-13 12:03:24,918 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/aacb9a520c884d588b938a2a3abae60c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/aacb9a520c884d588b938a2a3abae60c 2023-02-13 12:03:24,919 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/a21645d2a14c422c90a512a54816ff1c_SeqId_29_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/a21645d2a14c422c90a512a54816ff1c_SeqId_29_ 2023-02-13 12:03:24,919 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0a5a394bf83a414f988e525d1d5a439e of snapshot=snaptb-1676289787514 to region=1720c79b89223ff190ccb8a9ee0a2e40 table=testCompactionWithHFileLink 2023-02-13 12:03:24,919 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/b316682920b1441793a256fa7d4f007d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/b316682920b1441793a256fa7d4f007d 2023-02-13 12:03:24,919 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/e66e2146dae64575be37ae19a2558425_SeqId_29_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/e66e2146dae64575be37ae19a2558425_SeqId_29_ 2023-02-13 12:03:24,920 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bdac2c2855f842bc8fdce950c6a4d20d of snapshot=snaptb-1676289787514 to region=8ee7954bd40bd1dafda1c1f1de68abb8 table=testCompactionWithHFileLink 2023-02-13 12:03:24,920 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d146e457d6fd468698e71119ef297d9a of snapshot=snaptb-1676289787514 to region=a6f3edcaac9ede8077d2872e0a533416 table=testCompactionWithHFileLink 2023-02-13 12:03:24,923 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink de8f86d8ef124e78aa4321759f9ba242 of snapshot=snaptb-1676289787514 to region=a6f3edcaac9ede8077d2872e0a533416 table=testCompactionWithHFileLink 2023-02-13 12:03:24,923 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 118d505c73fe491eb7a1f5597b9456cc of snapshot=snaptb-1676289787514 to region=8ee7954bd40bd1dafda1c1f1de68abb8 table=testCompactionWithHFileLink 2023-02-13 12:03:24,923 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8eca9b704694444cb85cfd0aaf3c767d of snapshot=snaptb-1676289787514 to region=1720c79b89223ff190ccb8a9ee0a2e40 table=testCompactionWithHFileLink 2023-02-13 12:03:24,925 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a6f1a4a79535415a8c4f22ca595118b5 of snapshot=snaptb-1676289787514 to region=a6f3edcaac9ede8077d2872e0a533416 table=testCompactionWithHFileLink 2023-02-13 12:03:24,925 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ff70dcab71974ee689c282bdf9b306a1 of snapshot=snaptb-1676289787514 to region=8ee7954bd40bd1dafda1c1f1de68abb8 table=testCompactionWithHFileLink 2023-02-13 12:03:24,925 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7e203aee01d64da7b4116873e4b7d4c0 of snapshot=snaptb-1676289787514 to region=1720c79b89223ff190ccb8a9ee0a2e40 table=testCompactionWithHFileLink 2023-02-13 12:03:24,927 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7c65a056477b4ceebcc6ce4d80280b8f of snapshot=snaptb-1676289787514 to region=a6f3edcaac9ede8077d2872e0a533416 table=testCompactionWithHFileLink 2023-02-13 12:03:24,928 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f845fb56af5347828fe5d72c0005c3d9 of snapshot=snaptb-1676289787514 to region=1720c79b89223ff190ccb8a9ee0a2e40 table=testCompactionWithHFileLink 2023-02-13 12:03:24,928 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fc011753471f43d0899fbce127326f77 of snapshot=snaptb-1676289787514 to region=8ee7954bd40bd1dafda1c1f1de68abb8 table=testCompactionWithHFileLink 2023-02-13 12:03:24,932 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/7bf33bbed3ce4e4fa759deaf2237d965 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/7bf33bbed3ce4e4fa759deaf2237d965 2023-02-13 12:03:24,932 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/acfd9c4be78748239526688cadb08223 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/acfd9c4be78748239526688cadb08223 2023-02-13 12:03:24,932 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f2f764658363435985293fad4ef281a8 of snapshot=snaptb-1676289787514 to region=1720c79b89223ff190ccb8a9ee0a2e40 table=testCompactionWithHFileLink 2023-02-13 12:03:24,932 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e94601520c5647d6a976976240480ed1 of snapshot=snaptb-1676289787514 to region=a6f3edcaac9ede8077d2872e0a533416 table=testCompactionWithHFileLink 2023-02-13 12:03:24,933 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/f716791d17fb455da2cfbaff20e6cc3a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/f716791d17fb455da2cfbaff20e6cc3a 2023-02-13 12:03:24,933 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1bafa769e7c84ad286b828002b2e166a of snapshot=snaptb-1676289787514 to region=8ee7954bd40bd1dafda1c1f1de68abb8 table=testCompactionWithHFileLink 2023-02-13 12:03:24,935 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 12cce83299ed46d696cb3dd95fd7e722 of snapshot=snaptb-1676289787514 to region=1720c79b89223ff190ccb8a9ee0a2e40 table=testCompactionWithHFileLink 2023-02-13 12:03:24,936 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ee8387d608124fe09f646c11760c909e of snapshot=snaptb-1676289787514 to region=a6f3edcaac9ede8077d2872e0a533416 table=testCompactionWithHFileLink 2023-02-13 12:03:24,936 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6d98e29bb13446f78e6aace4e2d6e5ff of snapshot=snaptb-1676289787514 to region=8ee7954bd40bd1dafda1c1f1de68abb8 table=testCompactionWithHFileLink 2023-02-13 12:03:24,940 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2329f066e769429ea9b15082dda45516 of snapshot=snaptb-1676289787514 to region=1720c79b89223ff190ccb8a9ee0a2e40 table=testCompactionWithHFileLink 2023-02-13 12:03:24,940 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d58fda5c28374897bf0e579a35d076e2 of snapshot=snaptb-1676289787514 to region=a6f3edcaac9ede8077d2872e0a533416 table=testCompactionWithHFileLink 2023-02-13 12:03:24,941 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d9ca5e447a8a4a818bb6d80d89f5a04b of snapshot=snaptb-1676289787514 to region=8ee7954bd40bd1dafda1c1f1de68abb8 table=testCompactionWithHFileLink 2023-02-13 12:03:24,943 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 25e90067726942538cadd24fec06682c of snapshot=snaptb-1676289787514 to region=1720c79b89223ff190ccb8a9ee0a2e40 table=testCompactionWithHFileLink 2023-02-13 12:03:24,943 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ecd6814835be4497af4559cb933cb9f4 of snapshot=snaptb-1676289787514 to region=a6f3edcaac9ede8077d2872e0a533416 table=testCompactionWithHFileLink 2023-02-13 12:03:24,944 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5cc8e607d31e4ac8b676cba70b765713 of snapshot=snaptb-1676289787514 to region=8ee7954bd40bd1dafda1c1f1de68abb8 table=testCompactionWithHFileLink 2023-02-13 12:03:24,946 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676289787514" table: "testCompactionWithHFileLink" creation_time: 1676289787528 type: FLUSH version: 2 ttl: 0 2023-02-13 12:03:24,947 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676289804947"}]},"ts":"9223372036854775807"} 2023-02-13 12:03:24,947 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676289804947"}]},"ts":"9223372036854775807"} 2023-02-13 12:03:24,947 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676289804947"}]},"ts":"9223372036854775807"} 2023-02-13 12:03:24,949 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-13 12:03:24,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1720c79b89223ff190ccb8a9ee0a2e40, NAME => 'testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 8ee7954bd40bd1dafda1c1f1de68abb8, NAME => 'testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => a6f3edcaac9ede8077d2872e0a533416, NAME => 'testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.', STARTKEY => '', ENDKEY => '1'}] 2023-02-13 12:03:24,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289804948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289804948"}]},"ts":"1676289804948"} 2023-02-13 12:03:24,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289804948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289804948"}]},"ts":"1676289804948"} 2023-02-13 12:03:24,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289804948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289804948"}]},"ts":"1676289804948"} 2023-02-13 12:03:24,950 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 12:03:24,950 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-13 12:03:24,950 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 1720c79b89223ff190ccb8a9ee0a2e40, NAME => 'testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 8ee7954bd40bd1dafda1c1f1de68abb8, NAME => 'testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => a6f3edcaac9ede8077d2872e0a533416, NAME => 'testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.', STARTKEY => '', ENDKEY => '1'}] 2023-02-13 12:03:24,951 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676289787514 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-13 12:03:24,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676289787514" table: "testCompactionWithHFileLink" creation_time: 1676289787528 type: FLUSH version: 2 ttl: 0 ) in 529 msec 2023-02-13 12:03:25,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 12:03:25,039 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-13 12:03:25,039 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676289787514-1676289802245 2023-02-13 12:03:25,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(748): Client=jenkins//188.40.62.62 delete name: "hbase-failsafe-snaptb-1676289787514-1676289802245" 2023-02-13 12:03:25,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676289787514-1676289802245 2023-02-13 12:03:25,048 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-13 12:03:25,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$10(2372): Client=jenkins//188.40.62.62 enable testCompactionWithHFileLink 2023-02-13 12:03:25,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-13 12:03:25,061 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-13 12:03:25,061 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289805061"}]},"ts":"1676289805061"} 2023-02-13 12:03:25,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 12:03:25,062 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 12:03:25,095 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-13 12:03:25,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, ASSIGN}] 2023-02-13 12:03:25,097 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, ASSIGN 2023-02-13 12:03:25,097 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, ASSIGN 2023-02-13 12:03:25,097 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, ASSIGN 2023-02-13 12:03:25,098 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 12:03:25,098 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 12:03:25,098 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 12:03:25,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 12:03:25,252 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=8ee7954bd40bd1dafda1c1f1de68abb8, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:25,252 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1720c79b89223ff190ccb8a9ee0a2e40, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:25,252 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289805252"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289805252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289805252"}]},"ts":"1676289805252"} 2023-02-13 12:03:25,252 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=a6f3edcaac9ede8077d2872e0a533416, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:25,253 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289805252"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289805252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289805252"}]},"ts":"1676289805252"} 2023-02-13 12:03:25,253 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289805252"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289805252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289805252"}]},"ts":"1676289805252"} 2023-02-13 12:03:25,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 8ee7954bd40bd1dafda1c1f1de68abb8, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:25,258 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 1720c79b89223ff190ccb8a9ee0a2e40, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:25,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure a6f3edcaac9ede8077d2872e0a533416, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:25,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 12:03:25,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:25,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a6f3edcaac9ede8077d2872e0a533416, NAME => 'testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 12:03:25,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:25,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:25,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:25,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:25,421 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:25,422 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1 2023-02-13 12:03:25,422 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1 2023-02-13 12:03:25,423 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6f3edcaac9ede8077d2872e0a533416 columnFamilyName family1 2023-02-13 12:03:25,447 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-7c65a056477b4ceebcc6ce4d80280b8f 2023-02-13 12:03:25,452 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-a6f1a4a79535415a8c4f22ca595118b5 2023-02-13 12:03:25,458 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d146e457d6fd468698e71119ef297d9a 2023-02-13 12:03:25,464 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-de8f86d8ef124e78aa4321759f9ba242 2023-02-13 12:03:25,464 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(310): Store=a6f3edcaac9ede8077d2872e0a533416/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:25,465 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:25,466 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2 2023-02-13 12:03:25,466 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2 2023-02-13 12:03:25,466 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6f3edcaac9ede8077d2872e0a533416 columnFamilyName family2 2023-02-13 12:03:25,476 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d58fda5c28374897bf0e579a35d076e2 2023-02-13 12:03:25,481 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-e94601520c5647d6a976976240480ed1 2023-02-13 12:03:25,487 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ecd6814835be4497af4559cb933cb9f4 2023-02-13 12:03:25,493 DEBUG [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ee8387d608124fe09f646c11760c909e 2023-02-13 12:03:25,493 INFO [StoreOpener-a6f3edcaac9ede8077d2872e0a533416-1] regionserver.HStore(310): Store=a6f3edcaac9ede8077d2872e0a533416/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:25,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:25,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:25,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:03:25,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:03:25,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened a6f3edcaac9ede8077d2872e0a533416; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69655468, jitterRate=0.03794735670089722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:03:25,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for a6f3edcaac9ede8077d2872e0a533416: Running coprocessor pre-open hook at 1676289805418Writing region info on filesystem at 1676289805418Initializing all the Stores at 1676289805420 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289805420Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289805420Cleaning up temporary data from old regions at 1676289805496 (+76 ms)Cleaning up detritus from prior splits at 1676289805496Running coprocessor post-open hooks at 1676289805499 (+3 ms)Region opened successfully at 1676289805499 2023-02-13 12:03:25,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416., pid=103, masterSystemTime=1676289805410 2023-02-13 12:03:25,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:03:25,500 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 12:03:25,500 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 12:03:25,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 12:03:25,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:25,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:25,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:25,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1720c79b89223ff190ccb8a9ee0a2e40, NAME => 'testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 12:03:25,502 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=a6f3edcaac9ede8077d2872e0a533416, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:25,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:25,502 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289805502"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289805502"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289805502"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289805502"}]},"ts":"1676289805502"} 2023-02-13 12:03:25,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:25,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:25,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:25,502 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 12:03:25,502 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1912): a6f3edcaac9ede8077d2872e0a533416/family1 is initiating minor compaction (all files) 2023-02-13 12:03:25,503 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a6f3edcaac9ede8077d2872e0a533416/family1 in testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:25,503 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d146e457d6fd468698e71119ef297d9a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-de8f86d8ef124e78aa4321759f9ba242, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-a6f1a4a79535415a8c4f22ca595118b5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-7c65a056477b4ceebcc6ce4d80280b8f] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp, totalSize=21.6 K 2023-02-13 12:03:25,503 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 12:03:25,503 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1912): a6f3edcaac9ede8077d2872e0a533416/family2 is initiating minor compaction (all files) 2023-02-13 12:03:25,503 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2258): Starting compaction of a6f3edcaac9ede8077d2872e0a533416/family2 in testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:03:25,504 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-e94601520c5647d6a976976240480ed1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ee8387d608124fe09f646c11760c909e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d58fda5c28374897bf0e579a35d076e2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ecd6814835be4497af4559cb933cb9f4] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp, totalSize=20.4 K 2023-02-13 12:03:25,504 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d146e457d6fd468698e71119ef297d9a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779877 2023-02-13 12:03:25,504 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:25,504 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-e94601520c5647d6a976976240480ed1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779877 2023-02-13 12:03:25,505 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-de8f86d8ef124e78aa4321759f9ba242, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781790 2023-02-13 12:03:25,505 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ee8387d608124fe09f646c11760c909e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781790 2023-02-13 12:03:25,505 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-13 12:03:25,505 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure a6f3edcaac9ede8077d2872e0a533416, server=jenkins-hbase16.apache.org,39857,1676289663697 in 244 msec 2023-02-13 12:03:25,506 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1 2023-02-13 12:03:25,506 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1 2023-02-13 12:03:25,506 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d58fda5c28374897bf0e579a35d076e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783658 2023-02-13 12:03:25,506 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-a6f1a4a79535415a8c4f22ca595118b5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783658 2023-02-13 12:03:25,506 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1720c79b89223ff190ccb8a9ee0a2e40 columnFamilyName family1 2023-02-13 12:03:25,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a6f3edcaac9ede8077d2872e0a533416, ASSIGN in 410 msec 2023-02-13 12:03:25,507 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ecd6814835be4497af4559cb933cb9f4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:25,507 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-7c65a056477b4ceebcc6ce4d80280b8f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:25,521 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-0a5a394bf83a414f988e525d1d5a439e 2023-02-13 12:03:25,527 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-7e203aee01d64da7b4116873e4b7d4c0 2023-02-13 12:03:25,532 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] throttle.PressureAwareThroughputController(145): a6f3edcaac9ede8077d2872e0a533416#family2#compaction#114 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:25,534 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-8eca9b704694444cb85cfd0aaf3c767d 2023-02-13 12:03:25,535 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): a6f3edcaac9ede8077d2872e0a533416#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:25,543 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f845fb56af5347828fe5d72c0005c3d9 2023-02-13 12:03:25,543 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(310): Store=1720c79b89223ff190ccb8a9ee0a2e40/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:25,543 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:25,545 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2 2023-02-13 12:03:25,545 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2 2023-02-13 12:03:25,546 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1720c79b89223ff190ccb8a9ee0a2e40 columnFamilyName family2 2023-02-13 12:03:25,551 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-12cce83299ed46d696cb3dd95fd7e722 2023-02-13 12:03:25,555 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-2329f066e769429ea9b15082dda45516 2023-02-13 12:03:25,559 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-25e90067726942538cadd24fec06682c 2023-02-13 12:03:25,562 DEBUG [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f2f764658363435985293fad4ef281a8 2023-02-13 12:03:25,563 INFO [StoreOpener-1720c79b89223ff190ccb8a9ee0a2e40-1] regionserver.HStore(310): Store=1720c79b89223ff190ccb8a9ee0a2e40/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:25,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:25,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:25,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:03:25,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:03:25,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 1720c79b89223ff190ccb8a9ee0a2e40; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67717516, jitterRate=0.009069621562957764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:03:25,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 1720c79b89223ff190ccb8a9ee0a2e40: Running coprocessor pre-open hook at 1676289805502Writing region info on filesystem at 1676289805502Initializing all the Stores at 1676289805504 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289805504Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289805504Cleaning up temporary data from old regions at 1676289805564 (+60 ms)Cleaning up detritus from prior splits at 1676289805565 (+1 ms)Running coprocessor post-open hooks at 1676289805567 (+2 ms)Region opened successfully at 1676289805567 2023-02-13 12:03:25,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40., pid=102, masterSystemTime=1676289805410 2023-02-13 12:03:25,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 12:03:25,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-13 12:03:25,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:25,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:25,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:25,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8ee7954bd40bd1dafda1c1f1de68abb8, NAME => 'testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 12:03:25,569 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1720c79b89223ff190ccb8a9ee0a2e40, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:25,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:25,569 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676289805569"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289805569"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289805569"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289805569"}]},"ts":"1676289805569"} 2023-02-13 12:03:25,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:25,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:25,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:25,570 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:25,571 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1 2023-02-13 12:03:25,571 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1 2023-02-13 12:03:25,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-02-13 12:03:25,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 1720c79b89223ff190ccb8a9ee0a2e40, server=jenkins-hbase16.apache.org,39857,1676289663697 in 312 msec 2023-02-13 12:03:25,572 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ee7954bd40bd1dafda1c1f1de68abb8 columnFamilyName family1 2023-02-13 12:03:25,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1720c79b89223ff190ccb8a9ee0a2e40, ASSIGN in 477 msec 2023-02-13 12:03:25,577 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-118d505c73fe491eb7a1f5597b9456cc 2023-02-13 12:03:25,581 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-bdac2c2855f842bc8fdce950c6a4d20d 2023-02-13 12:03:25,585 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-fc011753471f43d0899fbce127326f77 2023-02-13 12:03:25,589 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-ff70dcab71974ee689c282bdf9b306a1 2023-02-13 12:03:25,589 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(310): Store=8ee7954bd40bd1dafda1c1f1de68abb8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:25,589 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:25,590 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2 2023-02-13 12:03:25,590 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2 2023-02-13 12:03:25,590 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ee7954bd40bd1dafda1c1f1de68abb8 columnFamilyName family2 2023-02-13 12:03:25,596 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-1bafa769e7c84ad286b828002b2e166a 2023-02-13 12:03:25,602 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-5cc8e607d31e4ac8b676cba70b765713 2023-02-13 12:03:25,607 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-6d98e29bb13446f78e6aace4e2d6e5ff 2023-02-13 12:03:25,612 DEBUG [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-d9ca5e447a8a4a818bb6d80d89f5a04b 2023-02-13 12:03:25,612 INFO [StoreOpener-8ee7954bd40bd1dafda1c1f1de68abb8-1] regionserver.HStore(310): Store=8ee7954bd40bd1dafda1c1f1de68abb8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:25,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:25,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:25,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:03:25,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:03:25,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 8ee7954bd40bd1dafda1c1f1de68abb8; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61890834, jitterRate=-0.07775470614433289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:03:25,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 8ee7954bd40bd1dafda1c1f1de68abb8: Running coprocessor pre-open hook at 1676289805569Writing region info on filesystem at 1676289805569Initializing all the Stores at 1676289805570 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289805570Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289805570Cleaning up temporary data from old regions at 1676289805614 (+44 ms)Cleaning up detritus from prior splits at 1676289805615 (+1 ms)Running coprocessor post-open hooks at 1676289805617 (+2 ms)Region opened successfully at 1676289805617 2023-02-13 12:03:25,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8., pid=101, masterSystemTime=1676289805410 2023-02-13 12:03:25,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 12:03:25,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 12:03:25,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:25,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:25,619 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=8ee7954bd40bd1dafda1c1f1de68abb8, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:25,620 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289805619"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289805619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289805619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289805619"}]},"ts":"1676289805619"} 2023-02-13 12:03:25,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-13 12:03:25,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 8ee7954bd40bd1dafda1c1f1de68abb8, server=jenkins-hbase16.apache.org,39857,1676289663697 in 365 msec 2023-02-13 12:03:25,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-02-13 12:03:25,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8ee7954bd40bd1dafda1c1f1de68abb8, ASSIGN in 527 msec 2023-02-13 12:03:25,624 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289805624"}]},"ts":"1676289805624"} 2023-02-13 12:03:25,625 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 12:03:25,652 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-13 12:03:25,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 598 msec 2023-02-13 12:03:25,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 12:03:25,666 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-13 12:03:25,685 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:25,695 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:25,704 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:25,705 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:25,711 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 12:03:25,723 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 12:03:25,723 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:25,724 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ReadOnlyZKClient(139): Connect 0x1bfdb30b to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:03:25,736 DEBUG [Listener at localhost.localdomain/40603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67eb9e1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:03:25,736 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:25,736 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:25,736 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:26,589 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302137f0cdd41a20f47fa9b5f32319948bab4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137f0cdd41a20f47fa9b5f32319948bab4 2023-02-13 12:03:26,590 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213b63f3ad523b24beaa6f72a70e0f7a5e6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213b63f3ad523b24beaa6f72a70e0f7a5e6 2023-02-13 12:03:26,590 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302134ccca54cefe74a8797f529a4ef2cff26 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134ccca54cefe74a8797f529a4ef2cff26 2023-02-13 12:03:26,590 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:26,590 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:26,591 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:26,605 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:03:26,608 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49312, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:03:26,614 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:03:26,631 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:03:26,642 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3efd2977e0c44947be684f8bd3cf8b0d first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-13 12:03:26,642 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/ce89f177b8ea43cca862b6e3c346457d first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-13 12:03:26,645 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3efd2977e0c44947be684f8bd3cf8b0d}] 2023-02-13 12:03:26,646 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/ce89f177b8ea43cca862b6e3c346457d}] 2023-02-13 12:03:26,654 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/ce89f177b8ea43cca862b6e3c346457d for inclusion in a6f3edcaac9ede8077d2872e0a533416/family1 2023-02-13 12:03:26,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3efd2977e0c44947be684f8bd3cf8b0d for inclusion in 8ee7954bd40bd1dafda1c1f1de68abb8/family1 2023-02-13 12:03:26,654 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/a95f2a2f9b4340f395179e93e8c4700e first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-13 12:03:26,655 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/a95f2a2f9b4340f395179e93e8c4700e}] 2023-02-13 12:03:26,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/a95f2a2f9b4340f395179e93e8c4700e for inclusion in 1720c79b89223ff190ccb8a9ee0a2e40/family1 2023-02-13 12:03:26,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-13 12:03:26,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-13 12:03:26,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 12:03:26,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 12:03:26,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:26,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:26,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3efd2977e0c44947be684f8bd3cf8b0d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__5mfi06hanifgbdnok77vdjn6898qa6kea41rjf30nbir75eirn9h2fag57ati11s/family1/3efd2977e0c44947be684f8bd3cf8b0d 2023-02-13 12:03:26,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/ce89f177b8ea43cca862b6e3c346457d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__1rl39afc0lpv56ffla77a6th1r2dnl3mj19l8el3a5ur6qefshlrsjh7uvoidudg/family1/ce89f177b8ea43cca862b6e3c346457d 2023-02-13 12:03:26,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-13 12:03:26,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 12:03:26,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:26,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__5mfi06hanifgbdnok77vdjn6898qa6kea41rjf30nbir75eirn9h2fag57ati11s/family1/3efd2977e0c44947be684f8bd3cf8b0d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/200400c7b82140989c6bdd82705d5e41_SeqId_34_ 2023-02-13 12:03:26,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/a95f2a2f9b4340f395179e93e8c4700e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__sbtfkosmjjhomrqfipll7hccsomf56c3toq5fcl6cao7m0a5pkk24s25hp96lfkb/family1/a95f2a2f9b4340f395179e93e8c4700e 2023-02-13 12:03:26,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__1rl39afc0lpv56ffla77a6th1r2dnl3mj19l8el3a5ur6qefshlrsjh7uvoidudg/family1/ce89f177b8ea43cca862b6e3c346457d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/9651086604324ee29d11dd384a3496c1_SeqId_34_ 2023-02-13 12:03:26,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__5mfi06hanifgbdnok77vdjn6898qa6kea41rjf30nbir75eirn9h2fag57ati11s/family1/3efd2977e0c44947be684f8bd3cf8b0d into 8ee7954bd40bd1dafda1c1f1de68abb8/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/200400c7b82140989c6bdd82705d5e41_SeqId_34_ - updating store file list. 2023-02-13 12:03:26,664 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__1rl39afc0lpv56ffla77a6th1r2dnl3mj19l8el3a5ur6qefshlrsjh7uvoidudg/family1/ce89f177b8ea43cca862b6e3c346457d into a6f3edcaac9ede8077d2872e0a533416/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/9651086604324ee29d11dd384a3496c1_SeqId_34_ - updating store file list. 2023-02-13 12:03:26,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__sbtfkosmjjhomrqfipll7hccsomf56c3toq5fcl6cao7m0a5pkk24s25hp96lfkb/family1/a95f2a2f9b4340f395179e93e8c4700e as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/ea94dc0569ab4ef09256d88dd04da524_SeqId_34_ 2023-02-13 12:03:26,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__sbtfkosmjjhomrqfipll7hccsomf56c3toq5fcl6cao7m0a5pkk24s25hp96lfkb/family1/a95f2a2f9b4340f395179e93e8c4700e into 1720c79b89223ff190ccb8a9ee0a2e40/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/ea94dc0569ab4ef09256d88dd04da524_SeqId_34_ - updating store file list. 2023-02-13 12:03:26,668 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/200400c7b82140989c6bdd82705d5e41_SeqId_34_ into 8ee7954bd40bd1dafda1c1f1de68abb8/family1 2023-02-13 12:03:26,668 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/9651086604324ee29d11dd384a3496c1_SeqId_34_ into a6f3edcaac9ede8077d2872e0a533416/family1 2023-02-13 12:03:26,668 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__5mfi06hanifgbdnok77vdjn6898qa6kea41rjf30nbir75eirn9h2fag57ati11s/family1/3efd2977e0c44947be684f8bd3cf8b0d into 8ee7954bd40bd1dafda1c1f1de68abb8/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/200400c7b82140989c6bdd82705d5e41_SeqId_34_) 2023-02-13 12:03:26,668 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__1rl39afc0lpv56ffla77a6th1r2dnl3mj19l8el3a5ur6qefshlrsjh7uvoidudg/family1/ce89f177b8ea43cca862b6e3c346457d into a6f3edcaac9ede8077d2872e0a533416/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/9651086604324ee29d11dd384a3496c1_SeqId_34_) 2023-02-13 12:03:26,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__5mfi06hanifgbdnok77vdjn6898qa6kea41rjf30nbir75eirn9h2fag57ati11s/family1/3efd2977e0c44947be684f8bd3cf8b0d 2023-02-13 12:03:26,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__1rl39afc0lpv56ffla77a6th1r2dnl3mj19l8el3a5ur6qefshlrsjh7uvoidudg/family1/ce89f177b8ea43cca862b6e3c346457d 2023-02-13 12:03:26,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:26,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/ea94dc0569ab4ef09256d88dd04da524_SeqId_34_ into 1720c79b89223ff190ccb8a9ee0a2e40/family1 2023-02-13 12:03:26,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__sbtfkosmjjhomrqfipll7hccsomf56c3toq5fcl6cao7m0a5pkk24s25hp96lfkb/family1/a95f2a2f9b4340f395179e93e8c4700e into 1720c79b89223ff190ccb8a9ee0a2e40/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/ea94dc0569ab4ef09256d88dd04da524_SeqId_34_) 2023-02-13 12:03:26,670 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:26,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testCompactionWithHFileLink__sbtfkosmjjhomrqfipll7hccsomf56c3toq5fcl6cao7m0a5pkk24s25hp96lfkb/family1/a95f2a2f9b4340f395179e93e8c4700e 2023-02-13 12:03:26,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-13 12:03:26,671 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:26,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(1912): 8ee7954bd40bd1dafda1c1f1de68abb8/family1 is initiating minor compaction (all files) 2023-02-13 12:03:26,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2b954b36; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 12:03:26,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:26,672 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302134f6a82906a024172a83b59dcaeabe10f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302134f6a82906a024172a83b59dcaeabe10f 2023-02-13 12:03:26,673 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:26,673 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:26,674 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302135708ebc13435471da46c7eeac9836dc0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302135708ebc13435471da46c7eeac9836dc0 2023-02-13 12:03:26,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-13 12:03:26,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 1720c79b89223ff190ccb8a9ee0a2e40/family1 is initiating minor compaction (all files) 2023-02-13 12:03:26,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6ef5c797; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-02-13 12:03:26,675 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021359806a53616a4990b523e65a17a0ae8a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021359806a53616a4990b523e65a17a0ae8a 2023-02-13 12:03:26,675 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302137c4c1fdd91234e5ea6ddbbec92505ea7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302137c4c1fdd91234e5ea6ddbbec92505ea7 2023-02-13 12:03:26,675 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213657f9ca972404f96b656baf96bd73fd0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213657f9ca972404f96b656baf96bd73fd0 2023-02-13 12:03:26,675 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:26,676 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021396bfd51cf01c432fa06fd872cc19033c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021396bfd51cf01c432fa06fd872cc19033c 2023-02-13 12:03:26,675 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 12:03:26,676 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 12:03:26,676 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:26,676 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:26,676 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302139fdff0434e8d4d9d9ba42be4bf419bf7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302139fdff0434e8d4d9d9ba42be4bf419bf7 2023-02-13 12:03:26,677 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213cd865ad2381249e5afca9f2669c964e2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213cd865ad2381249e5afca9f2669c964e2 2023-02-13 12:03:26,677 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 12:03:26,677 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 12:03:26,677 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302136bc33b7545c84473af738e49243037e7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302136bc33b7545c84473af738e49243037e7 2023-02-13 12:03:26,678 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:26,678 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302138b4465b0514c4bb6a0aa8d83b9b3d879 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302138b4465b0514c4bb6a0aa8d83b9b3d879 2023-02-13 12:03:26,679 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302138baef262e654434da997f58c60408a89 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302138baef262e654434da997f58c60408a89 2023-02-13 12:03:26,680 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213ef71206b667443b29e87b9b6fe1e58c2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213ef71206b667443b29e87b9b6fe1e58c2 2023-02-13 12:03:26,680 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 12:03:26,680 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 12:03:26,680 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 12:03:26,680 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 12:03:26,682 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:26,685 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:26,689 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:26,690 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:26,697 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:26,697 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:26,714 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=286 (was 244) - Thread LEAK? -, OpenFileDescriptor=765 (was 608) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=52 (was 77), ProcessCount=165 (was 165), AvailableMemoryMB=5942 (was 6059) 2023-02-13 12:03:26,724 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=285, OpenFileDescriptor=765, MaxFileDescriptor=60000, SystemLoadAverage=52, ProcessCount=165, AvailableMemoryMB=5941 2023-02-13 12:03:26,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$15(2997): Client=jenkins//188.40.62.62 creating {NAME => 'ns'} 2023-02-13 12:03:26,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-13 12:03:26,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 12:03:26,765 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family2/4ced1f7c8239495683b00bdfbfd7fc32 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/4ced1f7c8239495683b00bdfbfd7fc32 2023-02-13 12:03:26,765 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/.tmp/family1/232e7ad2c00844098e4ed9f5352f4d1a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/232e7ad2c00844098e4ed9f5352f4d1a 2023-02-13 12:03:26,769 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 12:03:26,770 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-13 12:03:26,770 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-13 12:03:26,772 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a6f3edcaac9ede8077d2872e0a533416/family1 of a6f3edcaac9ede8077d2872e0a533416 into 232e7ad2c00844098e4ed9f5352f4d1a(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:26,772 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a6f3edcaac9ede8077d2872e0a533416/family2 of a6f3edcaac9ede8077d2872e0a533416 into 4ced1f7c8239495683b00bdfbfd7fc32(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:26,772 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:26,772 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for a6f3edcaac9ede8077d2872e0a533416: 2023-02-13 12:03:26,772 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416., storeName=a6f3edcaac9ede8077d2872e0a533416/family1, priority=12, startTime=1676289805499; duration=1sec 2023-02-13 12:03:26,772 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416., storeName=a6f3edcaac9ede8077d2872e0a533416/family2, priority=12, startTime=1676289805500; duration=1sec 2023-02-13 12:03:26,772 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-02-13 12:03:26,772 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-02-13 12:03:26,772 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8ee7954bd40bd1dafda1c1f1de68abb8/family1 in testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:26,772 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 1720c79b89223ff190ccb8a9ee0a2e40/family1 in testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:26,773 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-bdac2c2855f842bc8fdce950c6a4d20d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-118d505c73fe491eb7a1f5597b9456cc, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-ff70dcab71974ee689c282bdf9b306a1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-fc011753471f43d0899fbce127326f77, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/200400c7b82140989c6bdd82705d5e41_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp, totalSize=28.9 K 2023-02-13 12:03:26,773 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-0a5a394bf83a414f988e525d1d5a439e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-8eca9b704694444cb85cfd0aaf3c767d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-7e203aee01d64da7b4116873e4b7d4c0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f845fb56af5347828fe5d72c0005c3d9, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/ea94dc0569ab4ef09256d88dd04da524_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp, totalSize=28.9 K 2023-02-13 12:03:26,773 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-bdac2c2855f842bc8fdce950c6a4d20d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779878 2023-02-13 12:03:26,773 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-0a5a394bf83a414f988e525d1d5a439e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779878 2023-02-13 12:03:26,774 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-118d505c73fe491eb7a1f5597b9456cc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781791 2023-02-13 12:03:26,774 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-8eca9b704694444cb85cfd0aaf3c767d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781791 2023-02-13 12:03:26,775 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-ff70dcab71974ee689c282bdf9b306a1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783659 2023-02-13 12:03:26,775 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-7e203aee01d64da7b4116873e4b7d4c0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783660 2023-02-13 12:03:26,775 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-fc011753471f43d0899fbce127326f77, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:26,776 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f845fb56af5347828fe5d72c0005c3d9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:26,776 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 200400c7b82140989c6bdd82705d5e41_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676289779878 2023-02-13 12:03:26,776 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting ea94dc0569ab4ef09256d88dd04da524_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676289779878 2023-02-13 12:03:26,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 49 msec 2023-02-13 12:03:26,789 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8ee7954bd40bd1dafda1c1f1de68abb8#family1#compaction#116 average throughput is 2.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:26,790 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] throttle.PressureAwareThroughputController(145): 1720c79b89223ff190ccb8a9ee0a2e40#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:26,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 12:03:26,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 12:03:26,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-13 12:03:26,840 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:03:26,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-13 12:03:26,841 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:03:26,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 12:03:26,845 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:26,845 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:26,845 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:26,845 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b empty. 2023-02-13 12:03:26,846 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99 empty. 2023-02-13 12:03:26,846 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7 empty. 2023-02-13 12:03:26,846 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:26,846 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:26,846 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:26,846 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-13 12:03:26,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d146e457d6fd468698e71119ef297d9a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-de8f86d8ef124e78aa4321759f9ba242, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-a6f1a4a79535415a8c4f22ca595118b5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-7c65a056477b4ceebcc6ce4d80280b8f] to archive 2023-02-13 12:03:26,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:26,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d146e457d6fd468698e71119ef297d9a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d146e457d6fd468698e71119ef297d9a 2023-02-13 12:03:26,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-de8f86d8ef124e78aa4321759f9ba242 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-de8f86d8ef124e78aa4321759f9ba242 2023-02-13 12:03:26,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-a6f1a4a79535415a8c4f22ca595118b5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-a6f1a4a79535415a8c4f22ca595118b5 2023-02-13 12:03:26,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-7c65a056477b4ceebcc6ce4d80280b8f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family1/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-7c65a056477b4ceebcc6ce4d80280b8f 2023-02-13 12:03:26,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-e94601520c5647d6a976976240480ed1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ee8387d608124fe09f646c11760c909e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d58fda5c28374897bf0e579a35d076e2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ecd6814835be4497af4559cb933cb9f4] to archive 2023-02-13 12:03:26,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:26,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-e94601520c5647d6a976976240480ed1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-e94601520c5647d6a976976240480ed1 2023-02-13 12:03:26,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ee8387d608124fe09f646c11760c909e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ee8387d608124fe09f646c11760c909e 2023-02-13 12:03:26,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d58fda5c28374897bf0e579a35d076e2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-d58fda5c28374897bf0e579a35d076e2 2023-02-13 12:03:26,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ecd6814835be4497af4559cb933cb9f4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/family2/testCompactionWithHFileLink=a6f3edcaac9ede8077d2872e0a533416-ecd6814835be4497af4559cb933cb9f4 2023-02-13 12:03:26,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 12:03:27,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 12:03:27,255 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 12:03:27,257 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4ed0c483c8c4fe40c830f90411f0787b, NAME => 'ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:03:27,257 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1534d71925ee596bd9145f02d5d5c9c7, NAME => 'ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:03:27,258 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => fad4ebb8447d36eec1c4a0d741c2ed99, NAME => 'ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:03:27,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 12:03:27,614 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family1/304d9b545278468ba2833d8c1809b5dc as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/304d9b545278468ba2833d8c1809b5dc 2023-02-13 12:03:27,620 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 1720c79b89223ff190ccb8a9ee0a2e40/family1 of 1720c79b89223ff190ccb8a9ee0a2e40 into 304d9b545278468ba2833d8c1809b5dc(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:03:27,620 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:27,620 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676289806674; duration=0sec 2023-02-13 12:03:27,621 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 12:03:27,621 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 12:03:27,624 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 12:03:27,624 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1912): 1720c79b89223ff190ccb8a9ee0a2e40/family2 is initiating minor compaction (all files) 2023-02-13 12:03:27,624 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 1720c79b89223ff190ccb8a9ee0a2e40/family2 in testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:03:27,624 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f2f764658363435985293fad4ef281a8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-12cce83299ed46d696cb3dd95fd7e722, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-2329f066e769429ea9b15082dda45516, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-25e90067726942538cadd24fec06682c] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp, totalSize=20.4 K 2023-02-13 12:03:27,625 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f2f764658363435985293fad4ef281a8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779878 2023-02-13 12:03:27,625 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-12cce83299ed46d696cb3dd95fd7e722, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781791 2023-02-13 12:03:27,626 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-2329f066e769429ea9b15082dda45516, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783660 2023-02-13 12:03:27,627 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-25e90067726942538cadd24fec06682c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:27,638 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] throttle.PressureAwareThroughputController(145): 1720c79b89223ff190ccb8a9ee0a2e40#family2#compaction#118 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:27,661 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:03:27,667 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:27,667 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:27,667 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 1534d71925ee596bd9145f02d5d5c9c7, disabling compactions & flushes 2023-02-13 12:03:27,667 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 4ed0c483c8c4fe40c830f90411f0787b, disabling compactions & flushes 2023-02-13 12:03:27,667 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:27,667 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:27,667 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:27,667 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:27,667 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. after waiting 0 ms 2023-02-13 12:03:27,667 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. after waiting 0 ms 2023-02-13 12:03:27,667 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:27,668 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:27,668 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:27,668 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:27,668 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:27,668 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 4ed0c483c8c4fe40c830f90411f0787b: Waiting for close lock at 1676289807667Disabling compacts and flushes for region at 1676289807667Disabling writes for close at 1676289807668 (+1 ms)Writing region close event to WAL at 1676289807668Closed at 1676289807668 2023-02-13 12:03:27,668 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing fad4ebb8447d36eec1c4a0d741c2ed99, disabling compactions & flushes 2023-02-13 12:03:27,668 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 1534d71925ee596bd9145f02d5d5c9c7: Waiting for close lock at 1676289807667Disabling compacts and flushes for region at 1676289807667Disabling writes for close at 1676289807667Writing region close event to WAL at 1676289807668 (+1 ms)Closed at 1676289807668 2023-02-13 12:03:27,668 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:27,668 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:27,668 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. after waiting 0 ms 2023-02-13 12:03:27,668 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:27,668 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:27,668 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for fad4ebb8447d36eec1c4a0d741c2ed99: Waiting for close lock at 1676289807668Disabling compacts and flushes for region at 1676289807668Disabling writes for close at 1676289807668Writing region close event to WAL at 1676289807668Closed at 1676289807668 2023-02-13 12:03:27,670 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:03:27,671 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676289807671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289807671"}]},"ts":"1676289807671"} 2023-02-13 12:03:27,671 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676289807671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289807671"}]},"ts":"1676289807671"} 2023-02-13 12:03:27,671 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676289807671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289807671"}]},"ts":"1676289807671"} 2023-02-13 12:03:27,673 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 12:03:27,673 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:03:27,674 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289807673"}]},"ts":"1676289807673"} 2023-02-13 12:03:27,674 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-13 12:03:27,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-0a5a394bf83a414f988e525d1d5a439e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-8eca9b704694444cb85cfd0aaf3c767d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-7e203aee01d64da7b4116873e4b7d4c0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f845fb56af5347828fe5d72c0005c3d9, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/ea94dc0569ab4ef09256d88dd04da524_SeqId_34_] to archive 2023-02-13 12:03:27,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:27,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-0a5a394bf83a414f988e525d1d5a439e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-0a5a394bf83a414f988e525d1d5a439e 2023-02-13 12:03:27,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-8eca9b704694444cb85cfd0aaf3c767d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-8eca9b704694444cb85cfd0aaf3c767d 2023-02-13 12:03:27,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-7e203aee01d64da7b4116873e4b7d4c0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-7e203aee01d64da7b4116873e4b7d4c0 2023-02-13 12:03:27,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f845fb56af5347828fe5d72c0005c3d9 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f845fb56af5347828fe5d72c0005c3d9 2023-02-13 12:03:27,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/ea94dc0569ab4ef09256d88dd04da524_SeqId_34_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family1/ea94dc0569ab4ef09256d88dd04da524_SeqId_34_ 2023-02-13 12:03:27,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4ed0c483c8c4fe40c830f90411f0787b, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fad4ebb8447d36eec1c4a0d741c2ed99, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1534d71925ee596bd9145f02d5d5c9c7, ASSIGN}] 2023-02-13 12:03:27,712 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4ed0c483c8c4fe40c830f90411f0787b, ASSIGN 2023-02-13 12:03:27,712 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1534d71925ee596bd9145f02d5d5c9c7, ASSIGN 2023-02-13 12:03:27,712 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fad4ebb8447d36eec1c4a0d741c2ed99, ASSIGN 2023-02-13 12:03:27,713 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4ed0c483c8c4fe40c830f90411f0787b, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:03:27,713 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1534d71925ee596bd9145f02d5d5c9c7, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:03:27,713 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fad4ebb8447d36eec1c4a0d741c2ed99, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:03:27,865 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=1534d71925ee596bd9145f02d5d5c9c7, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:27,865 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fad4ebb8447d36eec1c4a0d741c2ed99, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:27,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4ed0c483c8c4fe40c830f90411f0787b, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:27,866 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676289807865"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289807865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289807865"}]},"ts":"1676289807865"} 2023-02-13 12:03:27,866 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676289807865"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289807865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289807865"}]},"ts":"1676289807865"} 2023-02-13 12:03:27,866 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676289807865"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289807865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289807865"}]},"ts":"1676289807865"} 2023-02-13 12:03:27,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 1534d71925ee596bd9145f02d5d5c9c7, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:27,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 4ed0c483c8c4fe40c830f90411f0787b, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:27,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure fad4ebb8447d36eec1c4a0d741c2ed99, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:27,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 12:03:28,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:28,024 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family1/1638ad6d2db140a09eeefd1dd4082a49 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/1638ad6d2db140a09eeefd1dd4082a49 2023-02-13 12:03:28,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fad4ebb8447d36eec1c4a0d741c2ed99, NAME => 'ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 12:03:28,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:28,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:28,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:28,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:28,026 INFO [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:28,028 DEBUG [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1 2023-02-13 12:03:28,028 DEBUG [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1 2023-02-13 12:03:28,029 INFO [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fad4ebb8447d36eec1c4a0d741c2ed99 columnFamilyName family1 2023-02-13 12:03:28,031 INFO [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] regionserver.HStore(310): Store=fad4ebb8447d36eec1c4a0d741c2ed99/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:28,031 INFO [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:28,031 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 8ee7954bd40bd1dafda1c1f1de68abb8/family1 of 8ee7954bd40bd1dafda1c1f1de68abb8 into 1638ad6d2db140a09eeefd1dd4082a49(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:28,032 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:28,032 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676289806671; duration=1sec 2023-02-13 12:03:28,032 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 12:03:28,032 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 12:03:28,033 DEBUG [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2 2023-02-13 12:03:28,033 DEBUG [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2 2023-02-13 12:03:28,033 INFO [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fad4ebb8447d36eec1c4a0d741c2ed99 columnFamilyName family2 2023-02-13 12:03:28,035 INFO [StoreOpener-fad4ebb8447d36eec1c4a0d741c2ed99-1] regionserver.HStore(310): Store=fad4ebb8447d36eec1c4a0d741c2ed99/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:28,036 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 12:03:28,036 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1912): 8ee7954bd40bd1dafda1c1f1de68abb8/family2 is initiating minor compaction (all files) 2023-02-13 12:03:28,036 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8ee7954bd40bd1dafda1c1f1de68abb8/family2 in testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:03:28,036 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-1bafa769e7c84ad286b828002b2e166a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-6d98e29bb13446f78e6aace4e2d6e5ff, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-d9ca5e447a8a4a818bb6d80d89f5a04b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-5cc8e607d31e4ac8b676cba70b765713] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp, totalSize=20.4 K 2023-02-13 12:03:28,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:28,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:28,037 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-1bafa769e7c84ad286b828002b2e166a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289779878 2023-02-13 12:03:28,038 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-6d98e29bb13446f78e6aace4e2d6e5ff, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289781791 2023-02-13 12:03:28,039 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-d9ca5e447a8a4a818bb6d80d89f5a04b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289783659 2023-02-13 12:03:28,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:03:28,040 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-5cc8e607d31e4ac8b676cba70b765713, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289785590 2023-02-13 12:03:28,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:03:28,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:03:28,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened fad4ebb8447d36eec1c4a0d741c2ed99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59894459, jitterRate=-0.1075030118227005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:03:28,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for fad4ebb8447d36eec1c4a0d741c2ed99: Running coprocessor pre-open hook at 1676289808025Writing region info on filesystem at 1676289808025Initializing all the Stores at 1676289808026 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289808026Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289808026Cleaning up temporary data from old regions at 1676289808038 (+12 ms)Cleaning up detritus from prior splits at 1676289808039 (+1 ms)Running coprocessor post-open hooks at 1676289808044 (+5 ms)Region opened successfully at 1676289808044 2023-02-13 12:03:28,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99., pid=111, masterSystemTime=1676289808019 2023-02-13 12:03:28,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:28,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:28,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:28,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1534d71925ee596bd9145f02d5d5c9c7, NAME => 'ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 12:03:28,047 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fad4ebb8447d36eec1c4a0d741c2ed99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:28,047 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676289808047"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289808047"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289808047"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289808047"}]},"ts":"1676289808047"} 2023-02-13 12:03:28,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:28,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:28,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:28,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:28,048 INFO [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:28,050 DEBUG [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1 2023-02-13 12:03:28,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-13 12:03:28,050 DEBUG [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1 2023-02-13 12:03:28,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure fad4ebb8447d36eec1c4a0d741c2ed99, server=jenkins-hbase16.apache.org,39857,1676289663697 in 180 msec 2023-02-13 12:03:28,051 INFO [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1534d71925ee596bd9145f02d5d5c9c7 columnFamilyName family1 2023-02-13 12:03:28,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fad4ebb8447d36eec1c4a0d741c2ed99, ASSIGN in 340 msec 2023-02-13 12:03:28,052 INFO [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] regionserver.HStore(310): Store=1534d71925ee596bd9145f02d5d5c9c7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:28,052 INFO [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:28,054 DEBUG [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2 2023-02-13 12:03:28,054 DEBUG [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2 2023-02-13 12:03:28,054 INFO [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1534d71925ee596bd9145f02d5d5c9c7 columnFamilyName family2 2023-02-13 12:03:28,055 INFO [StoreOpener-1534d71925ee596bd9145f02d5d5c9c7-1] regionserver.HStore(310): Store=1534d71925ee596bd9145f02d5d5c9c7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:28,056 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8ee7954bd40bd1dafda1c1f1de68abb8#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:28,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:28,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:28,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:03:28,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:03:28,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:03:28,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 1534d71925ee596bd9145f02d5d5c9c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59577227, jitterRate=-0.11223013699054718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:03:28,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 1534d71925ee596bd9145f02d5d5c9c7: Running coprocessor pre-open hook at 1676289808047Writing region info on filesystem at 1676289808047Initializing all the Stores at 1676289808048 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289808048Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289808048Cleaning up temporary data from old regions at 1676289808057 (+9 ms)Cleaning up detritus from prior splits at 1676289808057Running coprocessor post-open hooks at 1676289808060 (+3 ms)Region opened successfully at 1676289808060 2023-02-13 12:03:28,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7., pid=109, masterSystemTime=1676289808019 2023-02-13 12:03:28,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:28,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:28,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:28,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4ed0c483c8c4fe40c830f90411f0787b, NAME => 'ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 12:03:28,062 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=1534d71925ee596bd9145f02d5d5c9c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:28,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:28,062 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676289808062"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289808062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289808062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289808062"}]},"ts":"1676289808062"} 2023-02-13 12:03:28,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:28,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:28,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:28,063 INFO [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:28,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-02-13 12:03:28,064 DEBUG [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1 2023-02-13 12:03:28,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 1534d71925ee596bd9145f02d5d5c9c7, server=jenkins-hbase16.apache.org,39857,1676289663697 in 196 msec 2023-02-13 12:03:28,064 DEBUG [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1 2023-02-13 12:03:28,064 INFO [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed0c483c8c4fe40c830f90411f0787b columnFamilyName family1 2023-02-13 12:03:28,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1534d71925ee596bd9145f02d5d5c9c7, ASSIGN in 354 msec 2023-02-13 12:03:28,065 INFO [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] regionserver.HStore(310): Store=4ed0c483c8c4fe40c830f90411f0787b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:28,065 INFO [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:28,066 DEBUG [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2 2023-02-13 12:03:28,066 DEBUG [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2 2023-02-13 12:03:28,066 INFO [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed0c483c8c4fe40c830f90411f0787b columnFamilyName family2 2023-02-13 12:03:28,067 INFO [StoreOpener-4ed0c483c8c4fe40c830f90411f0787b-1] regionserver.HStore(310): Store=4ed0c483c8c4fe40c830f90411f0787b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:28,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:28,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:28,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-bdac2c2855f842bc8fdce950c6a4d20d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-118d505c73fe491eb7a1f5597b9456cc, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-ff70dcab71974ee689c282bdf9b306a1, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-fc011753471f43d0899fbce127326f77, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/200400c7b82140989c6bdd82705d5e41_SeqId_34_] to archive 2023-02-13 12:03:28,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:28,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:03:28,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:03:28,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-bdac2c2855f842bc8fdce950c6a4d20d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-bdac2c2855f842bc8fdce950c6a4d20d 2023-02-13 12:03:28,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-118d505c73fe491eb7a1f5597b9456cc to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-118d505c73fe491eb7a1f5597b9456cc 2023-02-13 12:03:28,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:03:28,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 4ed0c483c8c4fe40c830f90411f0787b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60469507, jitterRate=-0.0989341288805008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:03:28,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 4ed0c483c8c4fe40c830f90411f0787b: Running coprocessor pre-open hook at 1676289808062Writing region info on filesystem at 1676289808062Initializing all the Stores at 1676289808063 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289808063Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289808063Cleaning up temporary data from old regions at 1676289808068 (+5 ms)Cleaning up detritus from prior splits at 1676289808068Running coprocessor post-open hooks at 1676289808072 (+4 ms)Region opened successfully at 1676289808072 2023-02-13 12:03:28,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-ff70dcab71974ee689c282bdf9b306a1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-ff70dcab71974ee689c282bdf9b306a1 2023-02-13 12:03:28,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b., pid=110, masterSystemTime=1676289808019 2023-02-13 12:03:28,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-fc011753471f43d0899fbce127326f77 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-fc011753471f43d0899fbce127326f77 2023-02-13 12:03:28,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:28,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:28,074 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4ed0c483c8c4fe40c830f90411f0787b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:28,074 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676289808074"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289808074"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289808074"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289808074"}]},"ts":"1676289808074"} 2023-02-13 12:03:28,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/200400c7b82140989c6bdd82705d5e41_SeqId_34_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family1/200400c7b82140989c6bdd82705d5e41_SeqId_34_ 2023-02-13 12:03:28,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-13 12:03:28,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 4ed0c483c8c4fe40c830f90411f0787b, server=jenkins-hbase16.apache.org,39857,1676289663697 in 207 msec 2023-02-13 12:03:28,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-02-13 12:03:28,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4ed0c483c8c4fe40c830f90411f0787b, ASSIGN in 366 msec 2023-02-13 12:03:28,078 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:03:28,078 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289808078"}]},"ts":"1676289808078"} 2023-02-13 12:03:28,079 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-13 12:03:28,111 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:03:28,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2740 sec 2023-02-13 12:03:28,874 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/.tmp/family2/99ee69be472c4dbe9e22778b697ddd0f as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/99ee69be472c4dbe9e22778b697ddd0f 2023-02-13 12:03:28,879 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 1720c79b89223ff190ccb8a9ee0a2e40/family2 of 1720c79b89223ff190ccb8a9ee0a2e40 into 99ee69be472c4dbe9e22778b697ddd0f(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:28,879 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 1720c79b89223ff190ccb8a9ee0a2e40: 2023-02-13 12:03:28,879 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40., storeName=1720c79b89223ff190ccb8a9ee0a2e40/family2, priority=12, startTime=1676289805568; duration=1sec 2023-02-13 12:03:28,879 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-13 12:03:28,880 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-13 12:03:28,880 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 12:03:28,880 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 12:03:28,880 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. because compaction request was cancelled 2023-02-13 12:03:28,880 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-13 12:03:28,881 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 12:03:28,881 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 12:03:28,881 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. because compaction request was cancelled 2023-02-13 12:03:28,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 12:03:28,952 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-13 12:03:28,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:28,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:28,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:28,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:28,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 12:03:28,971 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 12:03:28,971 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:28,971 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 12:03:28,971 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 12:03:28,971 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:28,971 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:28,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f2f764658363435985293fad4ef281a8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-12cce83299ed46d696cb3dd95fd7e722, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-2329f066e769429ea9b15082dda45516, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-25e90067726942538cadd24fec06682c] to archive 2023-02-13 12:03:28,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:28,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f2f764658363435985293fad4ef281a8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-f2f764658363435985293fad4ef281a8 2023-02-13 12:03:28,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-12cce83299ed46d696cb3dd95fd7e722 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-12cce83299ed46d696cb3dd95fd7e722 2023-02-13 12:03:28,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-2329f066e769429ea9b15082dda45516 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-2329f066e769429ea9b15082dda45516 2023-02-13 12:03:28,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-25e90067726942538cadd24fec06682c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/family2/testCompactionWithHFileLink=1720c79b89223ff190ccb8a9ee0a2e40-25e90067726942538cadd24fec06682c 2023-02-13 12:03:28,985 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:28,985 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:28,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:28,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:28,986 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:28,986 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:28,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:28,986 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 12:03:28,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 12:03:28,987 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 12:03:28,987 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:28,987 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 12:03:28,987 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:28,987 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. started... 2023-02-13 12:03:28,989 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:28,989 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fad4ebb8447d36eec1c4a0d741c2ed99 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 12:03:28,989 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:28,989 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. started... 2023-02-13 12:03:28,989 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. started... 2023-02-13 12:03:28,989 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:03:28,989 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:28,989 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1534d71925ee596bd9145f02d5d5c9c7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 12:03:28,989 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4ed0c483c8c4fe40c830f90411f0787b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 12:03:29,006 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302130e063aa576a147dc99c97f2b6dae3c59 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302130e063aa576a147dc99c97f2b6dae3c59 2023-02-13 12:03:29,288 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/.tmp/family2/fea9bfc8855746cf8038651a1fe227b9 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/fea9bfc8855746cf8038651a1fe227b9 2023-02-13 12:03:29,297 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 8ee7954bd40bd1dafda1c1f1de68abb8/family2 of 8ee7954bd40bd1dafda1c1f1de68abb8 into fea9bfc8855746cf8038651a1fe227b9(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:29,297 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8ee7954bd40bd1dafda1c1f1de68abb8: 2023-02-13 12:03:29,297 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8., storeName=8ee7954bd40bd1dafda1c1f1de68abb8/family2, priority=12, startTime=1676289805618; duration=1sec 2023-02-13 12:03:29,297 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:03:29,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-1bafa769e7c84ad286b828002b2e166a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-6d98e29bb13446f78e6aace4e2d6e5ff, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-d9ca5e447a8a4a818bb6d80d89f5a04b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-5cc8e607d31e4ac8b676cba70b765713] to archive 2023-02-13 12:03:29,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:29,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-1bafa769e7c84ad286b828002b2e166a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-1bafa769e7c84ad286b828002b2e166a 2023-02-13 12:03:29,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-6d98e29bb13446f78e6aace4e2d6e5ff to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-6d98e29bb13446f78e6aace4e2d6e5ff 2023-02-13 12:03:29,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-d9ca5e447a8a4a818bb6d80d89f5a04b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-d9ca5e447a8a4a818bb6d80d89f5a04b 2023-02-13 12:03:29,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-5cc8e607d31e4ac8b676cba70b765713 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/family2/testCompactionWithHFileLink=8ee7954bd40bd1dafda1c1f1de68abb8-5cc8e607d31e4ac8b676cba70b765713 2023-02-13 12:03:29,411 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/6569500cf99a4e10ade361ed4a10cbec 2023-02-13 12:03:29,413 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302136402567629e64112ba22e827c7df1966 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302136402567629e64112ba22e827c7df1966 2023-02-13 12:03:29,413 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213099605b8ad2c4c8288ed43fd53b6b763 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213099605b8ad2c4c8288ed43fd53b6b763 2023-02-13 12:03:29,419 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/805445c800614428a116c03687c558c8 2023-02-13 12:03:29,522 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-13 12:03:29,821 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/49a9845314f24235a19c3334e26f4437 2023-02-13 12:03:29,833 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302135aceaf89f7b24c11ae28cb4074584642 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302135aceaf89f7b24c11ae28cb4074584642 2023-02-13 12:03:29,836 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021397021bff88b044b9b0937df084f7491d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021397021bff88b044b9b0937df084f7491d 2023-02-13 12:03:30,246 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/2b061aeec57247928cf306471957b597 2023-02-13 12:03:30,247 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/f3eb4611f0f04317803cc11eeb2ad39d 2023-02-13 12:03:30,255 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302131c29209d95ce4499a7d9a19e13f82c25 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302131c29209d95ce4499a7d9a19e13f82c25 2023-02-13 12:03:30,256 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/805445c800614428a116c03687c558c8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/805445c800614428a116c03687c558c8 2023-02-13 12:03:30,256 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/6569500cf99a4e10ade361ed4a10cbec as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/6569500cf99a4e10ade361ed4a10cbec 2023-02-13 12:03:30,260 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/805445c800614428a116c03687c558c8, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 12:03:30,260 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/6569500cf99a4e10ade361ed4a10cbec, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 12:03:30,261 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/f3eb4611f0f04317803cc11eeb2ad39d as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/f3eb4611f0f04317803cc11eeb2ad39d 2023-02-13 12:03:30,261 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/2b061aeec57247928cf306471957b597 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/2b061aeec57247928cf306471957b597 2023-02-13 12:03:30,264 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/f3eb4611f0f04317803cc11eeb2ad39d, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 12:03:30,264 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/2b061aeec57247928cf306471957b597, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 12:03:30,265 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1534d71925ee596bd9145f02d5d5c9c7 in 1276ms, sequenceid=5, compaction requested=false 2023-02-13 12:03:30,265 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fad4ebb8447d36eec1c4a0d741c2ed99 in 1276ms, sequenceid=5, compaction requested=false 2023-02-13 12:03:30,272 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1534d71925ee596bd9145f02d5d5c9c7: 2023-02-13 12:03:30,272 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fad4ebb8447d36eec1c4a0d741c2ed99: 2023-02-13 12:03:30,272 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:30,272 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:30,273 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:30,273 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:30,675 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/b3b87cebc8fd4a89934c0b22f4d2ee01 2023-02-13 12:03:30,686 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/49a9845314f24235a19c3334e26f4437 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/49a9845314f24235a19c3334e26f4437 2023-02-13 12:03:30,693 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/49a9845314f24235a19c3334e26f4437, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 12:03:30,694 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/b3b87cebc8fd4a89934c0b22f4d2ee01 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/b3b87cebc8fd4a89934c0b22f4d2ee01 2023-02-13 12:03:30,698 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/b3b87cebc8fd4a89934c0b22f4d2ee01, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 12:03:30,699 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4ed0c483c8c4fe40c830f90411f0787b in 1710ms, sequenceid=5, compaction requested=false 2023-02-13 12:03:30,699 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4ed0c483c8c4fe40c830f90411f0787b: 2023-02-13 12:03:30,699 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:30,699 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:30,700 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:30,700 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,700 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 12:03:30,700 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 12:03:30,727 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:30,727 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:30,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:30,728 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:30,728 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:30,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:30,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 12:03:30,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bde90e4[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:30,733 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 12:03:30,733 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:30,743 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:30,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:30,744 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,744 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:30,744 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 12:03:30,744 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 12:03:30,744 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:30,752 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 12:03:30,752 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:30,752 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 12:03:30,752 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:30,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:30,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:30,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:30,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:30,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:30,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:30,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:30,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 12:03:30,755 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 12:03:30,755 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:30,755 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:30,755 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 12:03:30,755 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:30,760 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:30,760 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:30,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:30,760 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:30,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:30,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:30,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:30,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:30,761 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:30,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:30,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:30,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:30,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:30,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:30,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:30,761 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:30,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:30,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,768 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:30,768 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:30,768 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:30,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 12:03:30,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 12:03:30,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:30,769 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:30,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:30,769 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:30,769 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:30,769 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:30,769 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,769 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:30,769 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:30,769 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:30,769 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:30,869 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:30,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:30,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:30,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:30,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:30,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:30,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:30,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 12:03:30,881 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 12:03:30,881 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:30,882 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 12:03:30,882 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 12:03:30,882 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:30,883 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:30,892 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:30,892 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:30,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:30,893 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:30,893 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:30,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:30,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:30,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:30,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:30,895 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 12:03:30,895 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 12:03:30,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 12:03:30,895 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 12:03:30,896 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:30,896 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 12:03:30,896 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:30,896 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:30,896 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:03:30,897 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:30,897 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. started... 2023-02-13 12:03:30,896 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. started... 2023-02-13 12:03:30,897 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4ed0c483c8c4fe40c830f90411f0787b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 12:03:30,897 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:30,897 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. started... 2023-02-13 12:03:30,897 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fad4ebb8447d36eec1c4a0d741c2ed99 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 12:03:30,898 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1534d71925ee596bd9145f02d5d5c9c7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 12:03:31,324 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213c47cf119f4614af38850379d7b7595a1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213c47cf119f4614af38850379d7b7595a1 2023-02-13 12:03:31,325 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213b7f2e7f818264db69c178a407da14c57 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213b7f2e7f818264db69c178a407da14c57 2023-02-13 12:03:31,325 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021393b297787cb143078206d0e1effacca6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021393b297787cb143078206d0e1effacca6 2023-02-13 12:03:31,337 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/3756291a999244f188c9dc14b33dc83b 2023-02-13 12:03:31,733 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/0e919f035c814eec96120b3cf7486905 2023-02-13 12:03:31,738 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/0f8c39b4b45d41b2a3e2e97c7e373a9a 2023-02-13 12:03:31,752 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021368a21c9d344f4939a4955ae4c0a8d15b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021368a21c9d344f4939a4955ae4c0a8d15b 2023-02-13 12:03:31,757 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213bff1e50c70fd4d689be7a3613dfc8c29 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213bff1e50c70fd4d689be7a3613dfc8c29 2023-02-13 12:03:31,761 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/1006c804dce84f2ca7f3bb136a6ff952 2023-02-13 12:03:31,765 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/3756291a999244f188c9dc14b33dc83b as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/3756291a999244f188c9dc14b33dc83b 2023-02-13 12:03:31,768 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/3756291a999244f188c9dc14b33dc83b, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 12:03:31,769 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/1006c804dce84f2ca7f3bb136a6ff952 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/1006c804dce84f2ca7f3bb136a6ff952 2023-02-13 12:03:31,771 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/1006c804dce84f2ca7f3bb136a6ff952, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 12:03:31,772 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4ed0c483c8c4fe40c830f90411f0787b in 875ms, sequenceid=9, compaction requested=false 2023-02-13 12:03:31,772 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4ed0c483c8c4fe40c830f90411f0787b: 2023-02-13 12:03:31,772 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:31,772 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:32,156 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302136e56824a246e49cd978a5857565b7823 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302136e56824a246e49cd978a5857565b7823 2023-02-13 12:03:32,165 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/6dd070ff376443e39f1593a1a85e5209 2023-02-13 12:03:32,171 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/0f8c39b4b45d41b2a3e2e97c7e373a9a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/0f8c39b4b45d41b2a3e2e97c7e373a9a 2023-02-13 12:03:32,177 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/0f8c39b4b45d41b2a3e2e97c7e373a9a, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 12:03:32,178 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/6dd070ff376443e39f1593a1a85e5209 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/6dd070ff376443e39f1593a1a85e5209 2023-02-13 12:03:32,183 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/6dd070ff376443e39f1593a1a85e5209, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 12:03:32,184 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1534d71925ee596bd9145f02d5d5c9c7 in 1286ms, sequenceid=9, compaction requested=false 2023-02-13 12:03:32,185 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1534d71925ee596bd9145f02d5d5c9c7: 2023-02-13 12:03:32,185 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:32,185 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:32,563 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/1594abb35d624161b2e6afea61ab08a2 2023-02-13 12:03:32,576 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/0e919f035c814eec96120b3cf7486905 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/0e919f035c814eec96120b3cf7486905 2023-02-13 12:03:32,584 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/0e919f035c814eec96120b3cf7486905, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 12:03:32,585 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/1594abb35d624161b2e6afea61ab08a2 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/1594abb35d624161b2e6afea61ab08a2 2023-02-13 12:03:32,590 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/1594abb35d624161b2e6afea61ab08a2, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 12:03:32,591 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fad4ebb8447d36eec1c4a0d741c2ed99 in 1694ms, sequenceid=9, compaction requested=false 2023-02-13 12:03:32,591 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fad4ebb8447d36eec1c4a0d741c2ed99: 2023-02-13 12:03:32,591 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:32,591 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:32,591 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:32,591 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,591 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 12:03:32,591 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 12:03:32,648 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,648 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:32,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:32,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:32,649 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:32,649 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:32,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:32,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:32,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:32,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:32,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 12:03:32,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37fce654[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:32,653 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 12:03:32,653 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:32,667 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:32,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:32,667 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 12:03:32,667 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 12:03:32,667 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:32,667 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,667 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:32,677 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 12:03:32,677 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:32,677 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 12:03:32,677 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:32,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 12:03:32,680 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 12:03:32,681 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:32,681 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:32,681 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 12:03:32,681 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:32,691 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:32,691 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:32,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:32,691 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:32,692 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:32,693 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,702 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,702 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:32,702 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:32,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 12:03:32,702 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:32,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 12:03:32,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:32,702 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:32,702 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,702 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:32,702 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:32,702 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:32,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:32,702 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:32,703 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:32,703 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:32,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:32,803 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:32,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:32,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:32,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:32,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:32,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:32,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:32,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 12:03:32,813 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 12:03:32,813 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:32,813 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 12:03:32,813 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 12:03:32,814 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:32,814 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:32,825 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:32,825 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:32,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:32,825 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:32,825 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:32,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:32,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:32,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:32,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:32,826 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 12:03:32,826 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 12:03:32,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 12:03:32,826 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 12:03:32,826 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:32,826 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 12:03:32,826 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:32,826 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:32,827 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. started... 2023-02-13 12:03:32,826 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. started... 2023-02-13 12:03:32,827 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1534d71925ee596bd9145f02d5d5c9c7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 12:03:32,827 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fad4ebb8447d36eec1c4a0d741c2ed99 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 12:03:32,827 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:03:32,827 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:32,827 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:32,827 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. started... 2023-02-13 12:03:32,827 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4ed0c483c8c4fe40c830f90411f0787b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 12:03:32,852 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ea57751c91614c498f81d5520f937f38 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213ea57751c91614c498f81d5520f937f38 2023-02-13 12:03:33,260 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/5fc730bd7c6f4f748d35b6e9fa963751 2023-02-13 12:03:33,261 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302130e0c7e6c1bc14196a1c82883e3a673e7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302130e0c7e6c1bc14196a1c82883e3a673e7 2023-02-13 12:03:33,261 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a1d78d329c7442d89cc747d9c173cc74 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213a1d78d329c7442d89cc747d9c173cc74 2023-02-13 12:03:33,529 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:03:33,573 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:03:33,573 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x157eede3 to 127.0.0.1:62284 2023-02-13 12:03:33,573 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:03:33,573 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:03:33,573 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bfdb30b to 127.0.0.1:62284 2023-02-13 12:03:33,573 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:03:33,667 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/8cd3d36aa167449eabaed6bd90756e59 2023-02-13 12:03:33,668 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/82a5c4dc09cf4873a2dec758a55a7fc6 2023-02-13 12:03:33,675 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021345eb9a20dcbc4b01b983d46300b5d429 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021345eb9a20dcbc4b01b983d46300b5d429 2023-02-13 12:03:33,680 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/c6f1c64cb607402fbb1b4a372e4b3fb0 2023-02-13 12:03:33,683 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/5fc730bd7c6f4f748d35b6e9fa963751 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/5fc730bd7c6f4f748d35b6e9fa963751 2023-02-13 12:03:33,687 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/5fc730bd7c6f4f748d35b6e9fa963751, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 12:03:33,687 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/c6f1c64cb607402fbb1b4a372e4b3fb0 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/c6f1c64cb607402fbb1b4a372e4b3fb0 2023-02-13 12:03:33,691 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/c6f1c64cb607402fbb1b4a372e4b3fb0, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 12:03:33,692 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1534d71925ee596bd9145f02d5d5c9c7 in 865ms, sequenceid=13, compaction requested=true 2023-02-13 12:03:33,692 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1534d71925ee596bd9145f02d5d5c9c7: 2023-02-13 12:03:33,692 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:33,692 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:34,090 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213e86916472e59453d919478a42733e9b1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213e86916472e59453d919478a42733e9b1 2023-02-13 12:03:34,091 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302130d5dd1217f16402eb3141d371f314e32 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302130d5dd1217f16402eb3141d371f314e32 2023-02-13 12:03:34,498 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/b6fe00fb5e014e65a5271ad05ad94fae 2023-02-13 12:03:34,498 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/124a0ec615234664a118aee9bd4204cd 2023-02-13 12:03:34,508 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/8cd3d36aa167449eabaed6bd90756e59 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8cd3d36aa167449eabaed6bd90756e59 2023-02-13 12:03:34,509 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/82a5c4dc09cf4873a2dec758a55a7fc6 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/82a5c4dc09cf4873a2dec758a55a7fc6 2023-02-13 12:03:34,514 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8cd3d36aa167449eabaed6bd90756e59, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 12:03:34,514 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/82a5c4dc09cf4873a2dec758a55a7fc6, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 12:03:34,515 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/b6fe00fb5e014e65a5271ad05ad94fae as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/b6fe00fb5e014e65a5271ad05ad94fae 2023-02-13 12:03:34,515 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/124a0ec615234664a118aee9bd4204cd as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/124a0ec615234664a118aee9bd4204cd 2023-02-13 12:03:34,520 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/124a0ec615234664a118aee9bd4204cd, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 12:03:34,520 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/b6fe00fb5e014e65a5271ad05ad94fae, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 12:03:34,521 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4ed0c483c8c4fe40c830f90411f0787b in 1694ms, sequenceid=13, compaction requested=true 2023-02-13 12:03:34,521 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fad4ebb8447d36eec1c4a0d741c2ed99 in 1694ms, sequenceid=13, compaction requested=true 2023-02-13 12:03:34,521 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4ed0c483c8c4fe40c830f90411f0787b: 2023-02-13 12:03:34,521 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fad4ebb8447d36eec1c4a0d741c2ed99: 2023-02-13 12:03:34,521 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:34,521 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:34,521 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:34,521 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:34,521 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:34,521 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,521 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 12:03:34,521 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 12:03:34,552 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:34,552 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:34,552 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:34,552 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:34,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 12:03:34,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17aa4ca6[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:34,554 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 12:03:34,554 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:34,560 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:34,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:34,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:34,560 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 12:03:34,560 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 12:03:34,560 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:34,560 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,560 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:34,568 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 12:03:34,568 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:34,568 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,568 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 12:03:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:34,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:34,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:34,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 12:03:34,574 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 12:03:34,574 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:34,574 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:34,574 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 12:03:34,574 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:34,585 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:34,585 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:34,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:34,585 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:34,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:34,586 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:34,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:34,589 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:34,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:34,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,602 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:34,602 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,602 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:34,602 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:34,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:34,602 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:34,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 12:03:34,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:34,602 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:34,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 12:03:34,603 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:34,603 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:34,604 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:34,603 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:34,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:34,604 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:34,704 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:34,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:34,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:34,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:34,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:03:34,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:34,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:34,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 12:03:34,720 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 12:03:34,720 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:34,720 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 12:03:34,720 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 12:03:34,721 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:34,721 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:34,727 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:34,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:34,727 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:34,727 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:34,727 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:34,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:34,728 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 12:03:34,729 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 12:03:34,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 12:03:34,729 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 12:03:34,729 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:34,729 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 12:03:34,729 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:34,729 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. started... 2023-02-13 12:03:34,729 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:34,729 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. started... 2023-02-13 12:03:34,729 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fad4ebb8447d36eec1c4a0d741c2ed99 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 12:03:34,729 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1534d71925ee596bd9145f02d5d5c9c7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 12:03:34,730 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:03:34,730 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:34,730 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:34,730 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. started... 2023-02-13 12:03:34,730 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4ed0c483c8c4fe40c830f90411f0787b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 12:03:35,154 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213e6a1322828124d68946bd1eb0cd4ebf1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213e6a1322828124d68946bd1eb0cd4ebf1 2023-02-13 12:03:35,154 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021391c9834978654fe9a63f597ff0314c80 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021391c9834978654fe9a63f597ff0314c80 2023-02-13 12:03:35,155 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302134cfd0d1cd4a44742b8430e1cce19c521 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302134cfd0d1cd4a44742b8430e1cce19c521 2023-02-13 12:03:35,561 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/63b645e0d51840faa87abd134db4c411 2023-02-13 12:03:35,561 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/9e95e4d1f1e24158948932fde8446dee 2023-02-13 12:03:35,562 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/86890db3a90449819c8ba9072029e7f8 2023-02-13 12:03:35,584 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021305afd6548d034f6cb265920c480d3430 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021305afd6548d034f6cb265920c480d3430 2023-02-13 12:03:35,989 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/959b1f4f7dec47548497a6c18bc9fc30 2023-02-13 12:03:35,993 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302132ff9ee5274624d23a0858f1eae3eac2a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302132ff9ee5274624d23a0858f1eae3eac2a 2023-02-13 12:03:35,993 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213369cd7ab9b6b4e24aeb4d3f6ce0fa5e6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213369cd7ab9b6b4e24aeb4d3f6ce0fa5e6 2023-02-13 12:03:35,996 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/63b645e0d51840faa87abd134db4c411 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/63b645e0d51840faa87abd134db4c411 2023-02-13 12:03:35,999 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/1e5c20e5e95f4c529127bfd6a618e58e 2023-02-13 12:03:36,002 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/63b645e0d51840faa87abd134db4c411, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 12:03:36,002 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/959b1f4f7dec47548497a6c18bc9fc30 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/959b1f4f7dec47548497a6c18bc9fc30 2023-02-13 12:03:36,003 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/86890db3a90449819c8ba9072029e7f8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/86890db3a90449819c8ba9072029e7f8 2023-02-13 12:03:36,007 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/959b1f4f7dec47548497a6c18bc9fc30, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 12:03:36,007 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/86890db3a90449819c8ba9072029e7f8, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 12:03:36,007 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4ed0c483c8c4fe40c830f90411f0787b in 1277ms, sequenceid=17, compaction requested=true 2023-02-13 12:03:36,007 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4ed0c483c8c4fe40c830f90411f0787b: 2023-02-13 12:03:36,008 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:36,008 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:36,008 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/1e5c20e5e95f4c529127bfd6a618e58e as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/1e5c20e5e95f4c529127bfd6a618e58e 2023-02-13 12:03:36,012 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/1e5c20e5e95f4c529127bfd6a618e58e, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 12:03:36,012 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1534d71925ee596bd9145f02d5d5c9c7 in 1283ms, sequenceid=17, compaction requested=true 2023-02-13 12:03:36,012 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1534d71925ee596bd9145f02d5d5c9c7: 2023-02-13 12:03:36,012 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:36,013 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:36,401 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/42b21d8b326c4e3eb097cf190ebce683 2023-02-13 12:03:36,414 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/9e95e4d1f1e24158948932fde8446dee as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/9e95e4d1f1e24158948932fde8446dee 2023-02-13 12:03:36,423 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/9e95e4d1f1e24158948932fde8446dee, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 12:03:36,424 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/42b21d8b326c4e3eb097cf190ebce683 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/42b21d8b326c4e3eb097cf190ebce683 2023-02-13 12:03:36,429 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/42b21d8b326c4e3eb097cf190ebce683, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 12:03:36,430 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fad4ebb8447d36eec1c4a0d741c2ed99 in 1701ms, sequenceid=17, compaction requested=true 2023-02-13 12:03:36,430 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fad4ebb8447d36eec1c4a0d741c2ed99: 2023-02-13 12:03:36,431 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:36,431 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:36,431 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:36,431 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,431 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 12:03:36,431 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 12:03:36,460 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:36,460 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:36,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:36,461 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:36,461 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:36,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:36,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 12:03:36,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54df2de9[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:36,466 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 12:03:36,466 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:36,477 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:36,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:36,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:36,477 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 12:03:36,477 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 12:03:36,477 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:36,478 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,478 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:36,485 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 12:03:36,485 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:36,485 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,485 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 12:03:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:36,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:36,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 12:03:36,495 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 12:03:36,495 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:36,495 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:36,495 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 12:03:36,495 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:36,502 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:36,502 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:36,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:36,502 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:36,503 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:36,504 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,516 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,516 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:36,517 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:36,517 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,517 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:36,516 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:36,517 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:36,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:36,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 12:03:36,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 12:03:36,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:36,517 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:36,518 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:36,518 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:36,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:36,518 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:36,518 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:36,618 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:36,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:36,637 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:36,642 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:36,648 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:36,649 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:36,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:36,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:36,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 12:03:36,677 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 12:03:36,677 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:36,677 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 12:03:36,677 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 12:03:36,677 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:36,677 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:36,685 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,685 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:36,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:36,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:36,685 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:36,685 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:36,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:36,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:36,686 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 12:03:36,687 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 12:03:36,687 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 12:03:36,687 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 12:03:36,687 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:36,687 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 12:03:36,687 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:36,687 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:36,687 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:03:36,687 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:36,687 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. started... 2023-02-13 12:03:36,687 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:36,687 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. started... 2023-02-13 12:03:36,687 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1534d71925ee596bd9145f02d5d5c9c7 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 12:03:36,687 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. started... 2023-02-13 12:03:36,687 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4ed0c483c8c4fe40c830f90411f0787b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 12:03:36,688 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fad4ebb8447d36eec1c4a0d741c2ed99 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 12:03:37,114 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/a6dfbde4e7a04855a604b27096f9e8f6 2023-02-13 12:03:37,118 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/67e081c4d8024665901a3f7464b255f8 2023-02-13 12:03:37,118 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6dfbde4e7a04855a604b27096f9e8f6 2023-02-13 12:03:37,121 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67e081c4d8024665901a3f7464b255f8 2023-02-13 12:03:37,516 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/13c83a03703640f8b6947f898bb9c3e2 2023-02-13 12:03:37,530 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13c83a03703640f8b6947f898bb9c3e2 2023-02-13 12:03:37,935 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/a683122d98c84d589ec60dec16dabeb5 2023-02-13 12:03:37,935 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/807f72033a804b1bb78c2d9d9cc62124 2023-02-13 12:03:37,945 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a683122d98c84d589ec60dec16dabeb5 2023-02-13 12:03:37,946 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 807f72033a804b1bb78c2d9d9cc62124 2023-02-13 12:03:37,947 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/a6dfbde4e7a04855a604b27096f9e8f6 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/a6dfbde4e7a04855a604b27096f9e8f6 2023-02-13 12:03:37,947 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/67e081c4d8024665901a3f7464b255f8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/67e081c4d8024665901a3f7464b255f8 2023-02-13 12:03:37,951 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6dfbde4e7a04855a604b27096f9e8f6 2023-02-13 12:03:37,951 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67e081c4d8024665901a3f7464b255f8 2023-02-13 12:03:37,951 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/a6dfbde4e7a04855a604b27096f9e8f6, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 12:03:37,951 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/67e081c4d8024665901a3f7464b255f8, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 12:03:37,952 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/a683122d98c84d589ec60dec16dabeb5 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/a683122d98c84d589ec60dec16dabeb5 2023-02-13 12:03:37,952 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/807f72033a804b1bb78c2d9d9cc62124 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/807f72033a804b1bb78c2d9d9cc62124 2023-02-13 12:03:37,962 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a683122d98c84d589ec60dec16dabeb5 2023-02-13 12:03:37,962 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/a683122d98c84d589ec60dec16dabeb5, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 12:03:37,962 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 807f72033a804b1bb78c2d9d9cc62124 2023-02-13 12:03:37,962 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/807f72033a804b1bb78c2d9d9cc62124, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 12:03:37,962 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fad4ebb8447d36eec1c4a0d741c2ed99 in 1274ms, sequenceid=23, compaction requested=true 2023-02-13 12:03:37,962 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1534d71925ee596bd9145f02d5d5c9c7 in 1275ms, sequenceid=23, compaction requested=true 2023-02-13 12:03:37,962 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fad4ebb8447d36eec1c4a0d741c2ed99: 2023-02-13 12:03:37,963 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1534d71925ee596bd9145f02d5d5c9c7: 2023-02-13 12:03:37,963 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:37,963 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:37,963 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:03:37,963 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:03:38,362 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/9d877590de514b1bbc31bc99a5c2bfff 2023-02-13 12:03:38,368 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d877590de514b1bbc31bc99a5c2bfff 2023-02-13 12:03:38,369 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/13c83a03703640f8b6947f898bb9c3e2 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/13c83a03703640f8b6947f898bb9c3e2 2023-02-13 12:03:38,375 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13c83a03703640f8b6947f898bb9c3e2 2023-02-13 12:03:38,375 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/13c83a03703640f8b6947f898bb9c3e2, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 12:03:38,376 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/9d877590de514b1bbc31bc99a5c2bfff as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/9d877590de514b1bbc31bc99a5c2bfff 2023-02-13 12:03:38,380 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d877590de514b1bbc31bc99a5c2bfff 2023-02-13 12:03:38,380 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/9d877590de514b1bbc31bc99a5c2bfff, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 12:03:38,381 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4ed0c483c8c4fe40c830f90411f0787b in 1694ms, sequenceid=23, compaction requested=true 2023-02-13 12:03:38,381 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4ed0c483c8c4fe40c830f90411f0787b: 2023-02-13 12:03:38,381 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:38,381 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:03:38,381 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:03:38,381 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,381 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 12:03:38,381 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 12:03:38,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:38,410 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:38,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:38,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:38,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:38,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:38,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 12:03:38,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b89ce26[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:38,412 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 12:03:38,413 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:38,436 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:38,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 12:03:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 12:03:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:38,437 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,437 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:38,452 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 12:03:38,452 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:38,452 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 12:03:38,452 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:38,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:38,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:38,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:38,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:38,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:38,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 12:03:38,460 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 12:03:38,460 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:38,460 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:38,460 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 12:03:38,460 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:38,468 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:38,469 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:38,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:38,469 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:38,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:38,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:38,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:38,470 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:38,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:38,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:38,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:38,473 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:38,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 12:03:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,485 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:38,485 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,485 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:38,485 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:38,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 12:03:38,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:38,485 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:38,485 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 12:03:38,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:38,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:38,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 12:03:38,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:38,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:38,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 12:03:38,486 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 12:03:38,486 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:38,487 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:38,587 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:38,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:38,590 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:38,591 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): fad4ebb8447d36eec1c4a0d741c2ed99/family1 is initiating major compaction (all files) 2023-02-13 12:03:38,591 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:38,591 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:38,592 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of fad4ebb8447d36eec1c4a0d741c2ed99/family1 in ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:38,592 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/6569500cf99a4e10ade361ed4a10cbec, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/0e919f035c814eec96120b3cf7486905, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8cd3d36aa167449eabaed6bd90756e59, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/9e95e4d1f1e24158948932fde8446dee, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/a6dfbde4e7a04855a604b27096f9e8f6] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp, totalSize=26.6 K 2023-02-13 12:03:38,594 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 6569500cf99a4e10ade361ed4a10cbec, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289808964 2023-02-13 12:03:38,595 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 0e919f035c814eec96120b3cf7486905, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289810873 2023-02-13 12:03:38,596 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 8cd3d36aa167449eabaed6bd90756e59, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289812806 2023-02-13 12:03:38,597 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 9e95e4d1f1e24158948932fde8446dee, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289814709 2023-02-13 12:03:38,598 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting a6dfbde4e7a04855a604b27096f9e8f6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:03:38,615 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): fad4ebb8447d36eec1c4a0d741c2ed99#family1#compaction#150 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:39,033 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302135b37294cb3154bd7933ea3d25825cc6a_del 2023-02-13 12:03:39,033 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302135b37294cb3154bd7933ea3d25825cc6a_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302135b37294cb3154bd7933ea3d25825cc6a_del 2023-02-13 12:03:39,864 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8951da8d3e1a4c8ba353da7225e0ab0c 2023-02-13 12:03:39,865 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family1/8951da8d3e1a4c8ba353da7225e0ab0c as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8951da8d3e1a4c8ba353da7225e0ab0c 2023-02-13 12:03:39,871 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8951da8d3e1a4c8ba353da7225e0ab0c 2023-02-13 12:03:39,872 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fad4ebb8447d36eec1c4a0d741c2ed99/family1 of fad4ebb8447d36eec1c4a0d741c2ed99 into 8951da8d3e1a4c8ba353da7225e0ab0c(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:39,872 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for fad4ebb8447d36eec1c4a0d741c2ed99: 2023-02-13 12:03:39,873 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:39,873 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): fad4ebb8447d36eec1c4a0d741c2ed99/family2 is initiating major compaction (all files) 2023-02-13 12:03:39,873 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:39,873 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:39,873 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of fad4ebb8447d36eec1c4a0d741c2ed99/family2 in ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:03:39,873 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/2b061aeec57247928cf306471957b597, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/1594abb35d624161b2e6afea61ab08a2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/b6fe00fb5e014e65a5271ad05ad94fae, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/42b21d8b326c4e3eb097cf190ebce683, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/a683122d98c84d589ec60dec16dabeb5] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp, totalSize=25.3 K 2023-02-13 12:03:39,874 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 2b061aeec57247928cf306471957b597, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289808964 2023-02-13 12:03:39,874 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 1594abb35d624161b2e6afea61ab08a2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289810873 2023-02-13 12:03:39,875 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting b6fe00fb5e014e65a5271ad05ad94fae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289812806 2023-02-13 12:03:39,875 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 42b21d8b326c4e3eb097cf190ebce683, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289814709 2023-02-13 12:03:39,876 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting a683122d98c84d589ec60dec16dabeb5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:03:39,885 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): fad4ebb8447d36eec1c4a0d741c2ed99#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:39,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/6569500cf99a4e10ade361ed4a10cbec, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/0e919f035c814eec96120b3cf7486905, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8cd3d36aa167449eabaed6bd90756e59, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/9e95e4d1f1e24158948932fde8446dee, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/a6dfbde4e7a04855a604b27096f9e8f6] to archive 2023-02-13 12:03:39,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:39,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/6569500cf99a4e10ade361ed4a10cbec to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/6569500cf99a4e10ade361ed4a10cbec 2023-02-13 12:03:39,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/0e919f035c814eec96120b3cf7486905 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/0e919f035c814eec96120b3cf7486905 2023-02-13 12:03:39,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8cd3d36aa167449eabaed6bd90756e59 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8cd3d36aa167449eabaed6bd90756e59 2023-02-13 12:03:39,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/9e95e4d1f1e24158948932fde8446dee to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/9e95e4d1f1e24158948932fde8446dee 2023-02-13 12:03:39,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/a6dfbde4e7a04855a604b27096f9e8f6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/a6dfbde4e7a04855a604b27096f9e8f6 2023-02-13 12:03:40,301 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302139236e43c603948aea19cf2051fdb2365_del 2023-02-13 12:03:40,301 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302139236e43c603948aea19cf2051fdb2365_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302139236e43c603948aea19cf2051fdb2365_del 2023-02-13 12:03:41,117 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a3d7f7305944409963b88690a5772e9 2023-02-13 12:03:41,118 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/.tmp/family2/5a3d7f7305944409963b88690a5772e9 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/5a3d7f7305944409963b88690a5772e9 2023-02-13 12:03:41,123 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a3d7f7305944409963b88690a5772e9 2023-02-13 12:03:41,124 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fad4ebb8447d36eec1c4a0d741c2ed99/family2 of fad4ebb8447d36eec1c4a0d741c2ed99 into 5a3d7f7305944409963b88690a5772e9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:41,124 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for fad4ebb8447d36eec1c4a0d741c2ed99: 2023-02-13 12:03:41,124 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:41,124 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 1534d71925ee596bd9145f02d5d5c9c7/family1 is initiating major compaction (all files) 2023-02-13 12:03:41,125 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:41,125 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:41,125 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 1534d71925ee596bd9145f02d5d5c9c7/family1 in ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:41,125 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/805445c800614428a116c03687c558c8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/0f8c39b4b45d41b2a3e2e97c7e373a9a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/5fc730bd7c6f4f748d35b6e9fa963751, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/86890db3a90449819c8ba9072029e7f8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/67e081c4d8024665901a3f7464b255f8] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp, totalSize=26.6 K 2023-02-13 12:03:41,125 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 805445c800614428a116c03687c558c8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289808965 2023-02-13 12:03:41,126 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 0f8c39b4b45d41b2a3e2e97c7e373a9a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289810873 2023-02-13 12:03:41,126 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 5fc730bd7c6f4f748d35b6e9fa963751, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289812806 2023-02-13 12:03:41,127 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 86890db3a90449819c8ba9072029e7f8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289814709 2023-02-13 12:03:41,127 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 67e081c4d8024665901a3f7464b255f8, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:03:41,137 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 1534d71925ee596bd9145f02d5d5c9c7#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:41,171 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/2b061aeec57247928cf306471957b597, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/1594abb35d624161b2e6afea61ab08a2, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/b6fe00fb5e014e65a5271ad05ad94fae, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/42b21d8b326c4e3eb097cf190ebce683, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/a683122d98c84d589ec60dec16dabeb5] to archive 2023-02-13 12:03:41,171 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:41,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/2b061aeec57247928cf306471957b597 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/2b061aeec57247928cf306471957b597 2023-02-13 12:03:41,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/1594abb35d624161b2e6afea61ab08a2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/1594abb35d624161b2e6afea61ab08a2 2023-02-13 12:03:41,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/b6fe00fb5e014e65a5271ad05ad94fae to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/b6fe00fb5e014e65a5271ad05ad94fae 2023-02-13 12:03:41,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/42b21d8b326c4e3eb097cf190ebce683 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/42b21d8b326c4e3eb097cf190ebce683 2023-02-13 12:03:41,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/a683122d98c84d589ec60dec16dabeb5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family2/a683122d98c84d589ec60dec16dabeb5 2023-02-13 12:03:41,553 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213ba624aabbe1b4f18b1d142ae29b4f48b_del 2023-02-13 12:03:41,553 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ba624aabbe1b4f18b1d142ae29b4f48b_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213ba624aabbe1b4f18b1d142ae29b4f48b_del 2023-02-13 12:03:41,977 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54fddcaa1ea444a6a10434a6eb5d4340 2023-02-13 12:03:41,978 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family1/54fddcaa1ea444a6a10434a6eb5d4340 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/54fddcaa1ea444a6a10434a6eb5d4340 2023-02-13 12:03:41,983 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54fddcaa1ea444a6a10434a6eb5d4340 2023-02-13 12:03:41,985 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1534d71925ee596bd9145f02d5d5c9c7/family1 of 1534d71925ee596bd9145f02d5d5c9c7 into 54fddcaa1ea444a6a10434a6eb5d4340(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:03:41,985 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 1534d71925ee596bd9145f02d5d5c9c7: 2023-02-13 12:03:41,985 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:41,985 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 1534d71925ee596bd9145f02d5d5c9c7/family2 is initiating major compaction (all files) 2023-02-13 12:03:41,985 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:41,985 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:41,986 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 1534d71925ee596bd9145f02d5d5c9c7/family2 in ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:03:41,986 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/f3eb4611f0f04317803cc11eeb2ad39d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/6dd070ff376443e39f1593a1a85e5209, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/c6f1c64cb607402fbb1b4a372e4b3fb0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/1e5c20e5e95f4c529127bfd6a618e58e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/807f72033a804b1bb78c2d9d9cc62124] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp, totalSize=25.3 K 2023-02-13 12:03:41,986 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting f3eb4611f0f04317803cc11eeb2ad39d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289808965 2023-02-13 12:03:41,987 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 6dd070ff376443e39f1593a1a85e5209, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289810873 2023-02-13 12:03:41,987 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting c6f1c64cb607402fbb1b4a372e4b3fb0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289812806 2023-02-13 12:03:41,987 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 1e5c20e5e95f4c529127bfd6a618e58e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289814709 2023-02-13 12:03:41,988 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 807f72033a804b1bb78c2d9d9cc62124, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:03:42,002 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 1534d71925ee596bd9145f02d5d5c9c7#family2#compaction#153 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:42,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/805445c800614428a116c03687c558c8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/0f8c39b4b45d41b2a3e2e97c7e373a9a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/5fc730bd7c6f4f748d35b6e9fa963751, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/86890db3a90449819c8ba9072029e7f8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/67e081c4d8024665901a3f7464b255f8] to archive 2023-02-13 12:03:42,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:42,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/805445c800614428a116c03687c558c8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/805445c800614428a116c03687c558c8 2023-02-13 12:03:42,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/0f8c39b4b45d41b2a3e2e97c7e373a9a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/0f8c39b4b45d41b2a3e2e97c7e373a9a 2023-02-13 12:03:42,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/5fc730bd7c6f4f748d35b6e9fa963751 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/5fc730bd7c6f4f748d35b6e9fa963751 2023-02-13 12:03:42,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/86890db3a90449819c8ba9072029e7f8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/86890db3a90449819c8ba9072029e7f8 2023-02-13 12:03:42,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/67e081c4d8024665901a3f7464b255f8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/67e081c4d8024665901a3f7464b255f8 2023-02-13 12:03:42,418 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213f7270b8717254e04b809306b1eacd32d_del 2023-02-13 12:03:42,418 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213f7270b8717254e04b809306b1eacd32d_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213f7270b8717254e04b809306b1eacd32d_del 2023-02-13 12:03:43,248 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d5c1930b29240709fac32f5252f8269 2023-02-13 12:03:43,249 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/.tmp/family2/4d5c1930b29240709fac32f5252f8269 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/4d5c1930b29240709fac32f5252f8269 2023-02-13 12:03:43,253 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d5c1930b29240709fac32f5252f8269 2023-02-13 12:03:43,254 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1534d71925ee596bd9145f02d5d5c9c7/family2 of 1534d71925ee596bd9145f02d5d5c9c7 into 4d5c1930b29240709fac32f5252f8269(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:03:43,254 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 1534d71925ee596bd9145f02d5d5c9c7: 2023-02-13 12:03:43,254 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:43,254 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 4ed0c483c8c4fe40c830f90411f0787b/family1 is initiating major compaction (all files) 2023-02-13 12:03:43,254 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:43,255 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:43,255 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 4ed0c483c8c4fe40c830f90411f0787b/family1 in ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:43,255 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/49a9845314f24235a19c3334e26f4437, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/3756291a999244f188c9dc14b33dc83b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/82a5c4dc09cf4873a2dec758a55a7fc6, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/63b645e0d51840faa87abd134db4c411, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/13c83a03703640f8b6947f898bb9c3e2] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp, totalSize=26.6 K 2023-02-13 12:03:43,255 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 49a9845314f24235a19c3334e26f4437, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289808963 2023-02-13 12:03:43,256 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 3756291a999244f188c9dc14b33dc83b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289810872 2023-02-13 12:03:43,256 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 82a5c4dc09cf4873a2dec758a55a7fc6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289812805 2023-02-13 12:03:43,257 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 63b645e0d51840faa87abd134db4c411, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289814708 2023-02-13 12:03:43,257 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 13c83a03703640f8b6947f898bb9c3e2, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:03:43,267 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 4ed0c483c8c4fe40c830f90411f0787b#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:43,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/f3eb4611f0f04317803cc11eeb2ad39d, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/6dd070ff376443e39f1593a1a85e5209, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/c6f1c64cb607402fbb1b4a372e4b3fb0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/1e5c20e5e95f4c529127bfd6a618e58e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/807f72033a804b1bb78c2d9d9cc62124] to archive 2023-02-13 12:03:43,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:43,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/f3eb4611f0f04317803cc11eeb2ad39d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/f3eb4611f0f04317803cc11eeb2ad39d 2023-02-13 12:03:43,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/6dd070ff376443e39f1593a1a85e5209 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/6dd070ff376443e39f1593a1a85e5209 2023-02-13 12:03:43,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/c6f1c64cb607402fbb1b4a372e4b3fb0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/c6f1c64cb607402fbb1b4a372e4b3fb0 2023-02-13 12:03:43,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/1e5c20e5e95f4c529127bfd6a618e58e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/1e5c20e5e95f4c529127bfd6a618e58e 2023-02-13 12:03:43,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/807f72033a804b1bb78c2d9d9cc62124 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family2/807f72033a804b1bb78c2d9d9cc62124 2023-02-13 12:03:43,683 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021344f9a02c7b634ebeba6052c8cbf9fc0e_del 2023-02-13 12:03:43,684 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021344f9a02c7b634ebeba6052c8cbf9fc0e_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021344f9a02c7b634ebeba6052c8cbf9fc0e_del 2023-02-13 12:03:43,699 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dae80cbf38b54ba5a5529a6b04ab22c3 2023-02-13 12:03:43,699 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family1/dae80cbf38b54ba5a5529a6b04ab22c3 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/dae80cbf38b54ba5a5529a6b04ab22c3 2023-02-13 12:03:43,702 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dae80cbf38b54ba5a5529a6b04ab22c3 2023-02-13 12:03:43,703 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4ed0c483c8c4fe40c830f90411f0787b/family1 of 4ed0c483c8c4fe40c830f90411f0787b into dae80cbf38b54ba5a5529a6b04ab22c3(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:03:43,703 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 4ed0c483c8c4fe40c830f90411f0787b: 2023-02-13 12:03:43,703 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:03:43,703 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 4ed0c483c8c4fe40c830f90411f0787b/family2 is initiating major compaction (all files) 2023-02-13 12:03:43,703 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:03:43,703 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:03:43,703 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 4ed0c483c8c4fe40c830f90411f0787b/family2 in ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:03:43,704 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/b3b87cebc8fd4a89934c0b22f4d2ee01, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/1006c804dce84f2ca7f3bb136a6ff952, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/124a0ec615234664a118aee9bd4204cd, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/959b1f4f7dec47548497a6c18bc9fc30, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/9d877590de514b1bbc31bc99a5c2bfff] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp, totalSize=25.3 K 2023-02-13 12:03:43,704 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting b3b87cebc8fd4a89934c0b22f4d2ee01, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289808963 2023-02-13 12:03:43,704 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 1006c804dce84f2ca7f3bb136a6ff952, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289810872 2023-02-13 12:03:43,704 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 124a0ec615234664a118aee9bd4204cd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289812805 2023-02-13 12:03:43,705 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 959b1f4f7dec47548497a6c18bc9fc30, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289814708 2023-02-13 12:03:43,705 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 9d877590de514b1bbc31bc99a5c2bfff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:03:43,711 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 4ed0c483c8c4fe40c830f90411f0787b#family2#compaction#155 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:43,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/49a9845314f24235a19c3334e26f4437, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/3756291a999244f188c9dc14b33dc83b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/82a5c4dc09cf4873a2dec758a55a7fc6, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/63b645e0d51840faa87abd134db4c411, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/13c83a03703640f8b6947f898bb9c3e2] to archive 2023-02-13 12:03:43,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:43,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/49a9845314f24235a19c3334e26f4437 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/49a9845314f24235a19c3334e26f4437 2023-02-13 12:03:43,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/3756291a999244f188c9dc14b33dc83b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/3756291a999244f188c9dc14b33dc83b 2023-02-13 12:03:43,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/82a5c4dc09cf4873a2dec758a55a7fc6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/82a5c4dc09cf4873a2dec758a55a7fc6 2023-02-13 12:03:43,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/63b645e0d51840faa87abd134db4c411 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/63b645e0d51840faa87abd134db4c411 2023-02-13 12:03:43,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/13c83a03703640f8b6947f898bb9c3e2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/13c83a03703640f8b6947f898bb9c3e2 2023-02-13 12:03:44,123 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213a9d8a46530d94a2f8b99b7377e23ff2f_del 2023-02-13 12:03:44,124 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a9d8a46530d94a2f8b99b7377e23ff2f_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213a9d8a46530d94a2f8b99b7377e23ff2f_del 2023-02-13 12:03:44,552 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5277ead292440d497af0c3f73a732cd 2023-02-13 12:03:44,553 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/.tmp/family2/d5277ead292440d497af0c3f73a732cd as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/d5277ead292440d497af0c3f73a732cd 2023-02-13 12:03:44,557 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5277ead292440d497af0c3f73a732cd 2023-02-13 12:03:44,558 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4ed0c483c8c4fe40c830f90411f0787b/family2 of 4ed0c483c8c4fe40c830f90411f0787b into d5277ead292440d497af0c3f73a732cd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:03:44,558 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 4ed0c483c8c4fe40c830f90411f0787b: 2023-02-13 12:03:44,562 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:44,565 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:44,569 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:44,570 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:44,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/b3b87cebc8fd4a89934c0b22f4d2ee01, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/1006c804dce84f2ca7f3bb136a6ff952, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/124a0ec615234664a118aee9bd4204cd, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/959b1f4f7dec47548497a6c18bc9fc30, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/9d877590de514b1bbc31bc99a5c2bfff] to archive 2023-02-13 12:03:44,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:44,577 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 12:03:44,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/b3b87cebc8fd4a89934c0b22f4d2ee01 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/b3b87cebc8fd4a89934c0b22f4d2ee01 2023-02-13 12:03:44,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/1006c804dce84f2ca7f3bb136a6ff952 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/1006c804dce84f2ca7f3bb136a6ff952 2023-02-13 12:03:44,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/124a0ec615234664a118aee9bd4204cd to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/124a0ec615234664a118aee9bd4204cd 2023-02-13 12:03:44,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/959b1f4f7dec47548497a6c18bc9fc30 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/959b1f4f7dec47548497a6c18bc9fc30 2023-02-13 12:03:44,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/9d877590de514b1bbc31bc99a5c2bfff to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family2/9d877590de514b1bbc31bc99a5c2bfff 2023-02-13 12:03:44,591 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-13 12:03:44,593 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021344f9a02c7b634ebeba6052c8cbf9fc0e_del 2023-02-13 12:03:44,595 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302135b37294cb3154bd7933ea3d25825cc6a_del 2023-02-13 12:03:44,598 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213ba624aabbe1b4f18b1d142ae29b4f48b_del 2023-02-13 12:03:44,598 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-13 12:03:44,598 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ReadOnlyZKClient(139): Connect 0x1c3cda66 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:03:44,644 DEBUG [Listener at localhost.localdomain/40603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bce363b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:03:44,646 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 12:03:44,646 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 12:03:44,646 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 12:03:45,075 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213eb92fd6d4d92441c86afb5950590d672 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213eb92fd6d4d92441c86afb5950590d672 2023-02-13 12:03:45,076 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 12:03:45,087 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:03:45,089 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:03:45,095 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:03:45,099 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34920, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:03:45,108 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/65c8b5e957824f78a4cac5361250691b first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-13 12:03:45,108 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/65c8b5e957824f78a4cac5361250691b}] 2023-02-13 12:03:45,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/65c8b5e957824f78a4cac5361250691b for inclusion in 4ed0c483c8c4fe40c830f90411f0787b/family1 2023-02-13 12:03:45,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-13 12:03:45,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 12:03:45,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 4ed0c483c8c4fe40c830f90411f0787b: 2023-02-13 12:03:45,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/65c8b5e957824f78a4cac5361250691b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__1kqcr5f1286s4rlguujscjcpqpkmqj3kl33gvqrrj65fl2hhqqg7ukkdui44ege9/family1/65c8b5e957824f78a4cac5361250691b 2023-02-13 12:03:45,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__1kqcr5f1286s4rlguujscjcpqpkmqj3kl33gvqrrj65fl2hhqqg7ukkdui44ege9/family1/65c8b5e957824f78a4cac5361250691b as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/a6534cf520c940439c0933db92d99468_SeqId_28_ 2023-02-13 12:03:45,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__1kqcr5f1286s4rlguujscjcpqpkmqj3kl33gvqrrj65fl2hhqqg7ukkdui44ege9/family1/65c8b5e957824f78a4cac5361250691b into 4ed0c483c8c4fe40c830f90411f0787b/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/a6534cf520c940439c0933db92d99468_SeqId_28_ - updating store file list. 2023-02-13 12:03:45,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/a6534cf520c940439c0933db92d99468_SeqId_28_ into 4ed0c483c8c4fe40c830f90411f0787b/family1 2023-02-13 12:03:45,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__1kqcr5f1286s4rlguujscjcpqpkmqj3kl33gvqrrj65fl2hhqqg7ukkdui44ege9/family1/65c8b5e957824f78a4cac5361250691b into 4ed0c483c8c4fe40c830f90411f0787b/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/family1/a6534cf520c940439c0933db92d99468_SeqId_28_) 2023-02-13 12:03:45,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__1kqcr5f1286s4rlguujscjcpqpkmqj3kl33gvqrrj65fl2hhqqg7ukkdui44ege9/family1/65c8b5e957824f78a4cac5361250691b 2023-02-13 12:03:45,125 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 12:03:45,125 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:45,127 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213099605b8ad2c4c8288ed43fd53b6b763 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213099605b8ad2c4c8288ed43fd53b6b763 2023-02-13 12:03:45,127 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 12:03:45,127 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 12:03:45,127 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 12:03:45,482 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021398fbc9374b1b4af0adcb22ac04a31728 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021398fbc9374b1b4af0adcb22ac04a31728 2023-02-13 12:03:45,482 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213db9e56fd3b4c4060853d5516a68dbd1b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213db9e56fd3b4c4060853d5516a68dbd1b 2023-02-13 12:03:45,483 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 12:03:45,483 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 12:03:45,507 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/af98f5f588bd49798a1ba9e533600256 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-13 12:03:45,508 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/af98f5f588bd49798a1ba9e533600256}] 2023-02-13 12:03:45,508 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9f7790271fb64f8bae9572038e02d8d1 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-13 12:03:45,509 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9f7790271fb64f8bae9572038e02d8d1}] 2023-02-13 12:03:45,510 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/af98f5f588bd49798a1ba9e533600256 for inclusion in fad4ebb8447d36eec1c4a0d741c2ed99/family1 2023-02-13 12:03:45,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9f7790271fb64f8bae9572038e02d8d1 for inclusion in 1534d71925ee596bd9145f02d5d5c9c7/family1 2023-02-13 12:03:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-13 12:03:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 12:03:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-13 12:03:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 12:03:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for fad4ebb8447d36eec1c4a0d741c2ed99: 2023-02-13 12:03:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 1534d71925ee596bd9145f02d5d5c9c7: 2023-02-13 12:03:45,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/af98f5f588bd49798a1ba9e533600256 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__r2jv38vi7u298jqq4ie0suf1nuvhq5nbhjo8pfvrh9l714kqlcie4kv86aqs49db/family1/af98f5f588bd49798a1ba9e533600256 2023-02-13 12:03:45,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9f7790271fb64f8bae9572038e02d8d1 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__l6smuq349h7jct4gl8uml4oif4nhh11u1d62nj4sar51ab8dr8mt055dvvov0tri/family1/9f7790271fb64f8bae9572038e02d8d1 2023-02-13 12:03:45,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__r2jv38vi7u298jqq4ie0suf1nuvhq5nbhjo8pfvrh9l714kqlcie4kv86aqs49db/family1/af98f5f588bd49798a1ba9e533600256 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8551444ddd184e7a971f4fc87ec2b13a_SeqId_28_ 2023-02-13 12:03:45,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__l6smuq349h7jct4gl8uml4oif4nhh11u1d62nj4sar51ab8dr8mt055dvvov0tri/family1/9f7790271fb64f8bae9572038e02d8d1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/e50d8df3867945e491c745f1e8bca9fd_SeqId_28_ 2023-02-13 12:03:45,514 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__r2jv38vi7u298jqq4ie0suf1nuvhq5nbhjo8pfvrh9l714kqlcie4kv86aqs49db/family1/af98f5f588bd49798a1ba9e533600256 into fad4ebb8447d36eec1c4a0d741c2ed99/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8551444ddd184e7a971f4fc87ec2b13a_SeqId_28_ - updating store file list. 2023-02-13 12:03:45,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__l6smuq349h7jct4gl8uml4oif4nhh11u1d62nj4sar51ab8dr8mt055dvvov0tri/family1/9f7790271fb64f8bae9572038e02d8d1 into 1534d71925ee596bd9145f02d5d5c9c7/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/e50d8df3867945e491c745f1e8bca9fd_SeqId_28_ - updating store file list. 2023-02-13 12:03:45,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/e50d8df3867945e491c745f1e8bca9fd_SeqId_28_ into 1534d71925ee596bd9145f02d5d5c9c7/family1 2023-02-13 12:03:45,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__l6smuq349h7jct4gl8uml4oif4nhh11u1d62nj4sar51ab8dr8mt055dvvov0tri/family1/9f7790271fb64f8bae9572038e02d8d1 into 1534d71925ee596bd9145f02d5d5c9c7/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/family1/e50d8df3867945e491c745f1e8bca9fd_SeqId_28_) 2023-02-13 12:03:45,517 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8551444ddd184e7a971f4fc87ec2b13a_SeqId_28_ into fad4ebb8447d36eec1c4a0d741c2ed99/family1 2023-02-13 12:03:45,517 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__r2jv38vi7u298jqq4ie0suf1nuvhq5nbhjo8pfvrh9l714kqlcie4kv86aqs49db/family1/af98f5f588bd49798a1ba9e533600256 into fad4ebb8447d36eec1c4a0d741c2ed99/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/family1/8551444ddd184e7a971f4fc87ec2b13a_SeqId_28_) 2023-02-13 12:03:45,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__l6smuq349h7jct4gl8uml4oif4nhh11u1d62nj4sar51ab8dr8mt055dvvov0tri/family1/9f7790271fb64f8bae9572038e02d8d1 2023-02-13 12:03:45,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__ns_testMinorCompaction__r2jv38vi7u298jqq4ie0suf1nuvhq5nbhjo8pfvrh9l714kqlcie4kv86aqs49db/family1/af98f5f588bd49798a1ba9e533600256 2023-02-13 12:03:45,518 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 12:03:45,518 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 12:03:45,519 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:45,519 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:45,520 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302136402567629e64112ba22e827c7df1966 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302136402567629e64112ba22e827c7df1966 2023-02-13 12:03:45,520 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 12:03:45,520 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302130e063aa576a147dc99c97f2b6dae3c59 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302130e063aa576a147dc99c97f2b6dae3c59 2023-02-13 12:03:45,520 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 12:03:45,520 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 12:03:45,520 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 12:03:45,521 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 12:03:45,521 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 12:03:45,521 INFO [Listener at localhost.localdomain/40603] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-13 12:03:45,523 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:45,525 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:45,528 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:03:45,529 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:03:45,547 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=248 (was 285), OpenFileDescriptor=612 (was 765), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=46 (was 52), ProcessCount=165 (was 165), AvailableMemoryMB=5947 (was 5941) - AvailableMemoryMB LEAK? - 2023-02-13 12:03:45,561 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=612, MaxFileDescriptor=60000, SystemLoadAverage=46, ProcessCount=165, AvailableMemoryMB=5947 2023-02-13 12:03:45,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 12:03:45,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:45,567 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:03:45,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-13 12:03:45,567 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:03:45,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 12:03:45,569 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:03:45,569 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7 empty. 2023-02-13 12:03:45,570 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:03:45,570 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-13 12:03:45,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 12:03:45,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 12:03:45,979 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 12:03:45,981 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 98ea924bbcf091ddc51e5c75dcdfc0b7, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:03:46,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 12:03:46,393 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:46,394 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 98ea924bbcf091ddc51e5c75dcdfc0b7, disabling compactions & flushes 2023-02-13 12:03:46,394 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:46,394 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:46,394 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. after waiting 0 ms 2023-02-13 12:03:46,394 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:46,394 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:46,394 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: Waiting for close lock at 1676289826394Disabling compacts and flushes for region at 1676289826394Disabling writes for close at 1676289826394Writing region close event to WAL at 1676289826394Closed at 1676289826394 2023-02-13 12:03:46,401 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:03:46,402 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676289826402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289826402"}]},"ts":"1676289826402"} 2023-02-13 12:03:46,404 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 12:03:46,405 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:03:46,405 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289826405"}]},"ts":"1676289826405"} 2023-02-13 12:03:46,406 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 12:03:46,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=98ea924bbcf091ddc51e5c75dcdfc0b7, ASSIGN}] 2023-02-13 12:03:46,446 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=98ea924bbcf091ddc51e5c75dcdfc0b7, ASSIGN 2023-02-13 12:03:46,448 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=98ea924bbcf091ddc51e5c75dcdfc0b7, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:03:46,600 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=98ea924bbcf091ddc51e5c75dcdfc0b7, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:46,600 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676289826600"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289826600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289826600"}]},"ts":"1676289826600"} 2023-02-13 12:03:46,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 98ea924bbcf091ddc51e5c75dcdfc0b7, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:03:46,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 12:03:46,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:46,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 98ea924bbcf091ddc51e5c75dcdfc0b7, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7.', STARTKEY => '', ENDKEY => ''} 2023-02-13 12:03:46,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:03:46,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:03:46,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:03:46,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:03:46,768 INFO [StoreOpener-98ea924bbcf091ddc51e5c75dcdfc0b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:03:46,770 DEBUG [StoreOpener-98ea924bbcf091ddc51e5c75dcdfc0b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1 2023-02-13 12:03:46,770 DEBUG [StoreOpener-98ea924bbcf091ddc51e5c75dcdfc0b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1 2023-02-13 12:03:46,771 INFO [StoreOpener-98ea924bbcf091ddc51e5c75dcdfc0b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98ea924bbcf091ddc51e5c75dcdfc0b7 columnFamilyName family1 2023-02-13 12:03:46,772 INFO [StoreOpener-98ea924bbcf091ddc51e5c75dcdfc0b7-1] regionserver.HStore(310): Store=98ea924bbcf091ddc51e5c75dcdfc0b7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:03:46,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:03:46,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:03:46,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:03:46,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:03:46,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 98ea924bbcf091ddc51e5c75dcdfc0b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65484073, jitterRate=-0.024211272597312927}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 12:03:46,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: Running coprocessor pre-open hook at 1676289826766Writing region info on filesystem at 1676289826766Initializing all the Stores at 1676289826768 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676289826768Cleaning up temporary data from old regions at 1676289826775 (+7 ms)Cleaning up detritus from prior splits at 1676289826775Running coprocessor post-open hooks at 1676289826782 (+7 ms)Region opened successfully at 1676289826782 2023-02-13 12:03:46,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7., pid=114, masterSystemTime=1676289826757 2023-02-13 12:03:46,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:46,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:46,786 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=98ea924bbcf091ddc51e5c75dcdfc0b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:46,786 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676289826786"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289826786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289826786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289826786"}]},"ts":"1676289826786"} 2023-02-13 12:03:46,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-13 12:03:46,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 98ea924bbcf091ddc51e5c75dcdfc0b7, server=jenkins-hbase16.apache.org,39857,1676289663697 in 184 msec 2023-02-13 12:03:46,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-13 12:03:46,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=98ea924bbcf091ddc51e5c75dcdfc0b7, ASSIGN in 347 msec 2023-02-13 12:03:46,793 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:03:46,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289826793"}]},"ts":"1676289826793"} 2023-02-13 12:03:46,795 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 12:03:46,828 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:03:46,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.2640 sec 2023-02-13 12:03:47,529 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:47,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 12:03:47,678 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-13 12:03:47,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:47,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:47,706 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:47,706 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:47,706 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:47,706 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:47,706 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:47,706 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:47,734 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:47,734 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:47,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:47,735 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:47,735 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:47,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:47,736 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:47,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:47,736 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:47,736 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:47,736 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:47,736 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:47,736 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:47,736 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:47,736 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:47,737 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 12:03:48,163 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303e4dd549a4e647dbaca4f7c28b976409 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511303e4dd549a4e647dbaca4f7c28b976409 2023-02-13 12:03:48,568 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/1d4dbf6f356b43df83900cf69ba0ee51 2023-02-13 12:03:48,574 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/1d4dbf6f356b43df83900cf69ba0ee51 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/1d4dbf6f356b43df83900cf69ba0ee51 2023-02-13 12:03:48,576 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/1d4dbf6f356b43df83900cf69ba0ee51, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 12:03:48,577 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 840ms, sequenceid=5, compaction requested=false 2023-02-13 12:03:48,578 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:48,578 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:48,578 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:48,578 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:48,578 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,578 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:48,578 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:48,609 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,609 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:48,610 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:48,610 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:48,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:48,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b974d45[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:48,613 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:48,613 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,651 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,652 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:48,652 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:48,652 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:48,652 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,652 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:48,666 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:48,666 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,666 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:48,666 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:48,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:48,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:48,676 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:48,676 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:48,676 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:48,676 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,676 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:48,684 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,684 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,684 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:48,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:48,685 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,687 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:48,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,693 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,693 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:48,693 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,693 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:48,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:03:48,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:48,693 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:48,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:48,693 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,693 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:48,694 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,694 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,694 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:48,694 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:48,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:48,694 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,794 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:48,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:48,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:48,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:48,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,811 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:48,811 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:48,811 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:48,811 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:48,811 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,811 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,818 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:48,818 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:48,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:48,818 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:48,819 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,820 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,820 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:03:48,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:48,820 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:48,820 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:48,820 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:48,820 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:48,820 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:48,820 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:48,821 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:48,821 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 12:03:49,239 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283fa66ff18e2e4b13b88bf18500f82f20 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511283fa66ff18e2e4b13b88bf18500f82f20 2023-02-13 12:03:49,645 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/8ba168acba6c4457a8fde6e42153f741 2023-02-13 12:03:49,656 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/8ba168acba6c4457a8fde6e42153f741 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/8ba168acba6c4457a8fde6e42153f741 2023-02-13 12:03:49,661 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/8ba168acba6c4457a8fde6e42153f741, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 12:03:49,662 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 841ms, sequenceid=9, compaction requested=false 2023-02-13 12:03:49,662 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:49,662 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:49,662 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:49,662 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:49,662 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,662 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:49,662 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:49,674 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,674 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:49,674 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,674 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:49,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:49,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e1defed[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:49,676 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:49,676 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,684 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,685 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:49,685 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:49,685 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:49,685 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,685 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:49,693 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:49,693 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:49,693 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,693 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:49,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:49,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:49,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:49,697 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:49,698 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:49,698 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:49,698 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,698 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:49,707 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,707 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,708 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:49,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:49,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:49,709 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:49,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:49,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,711 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,754 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:49,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:49,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:49,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:49,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,754 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:49,755 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:49,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:49,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:49,855 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:49,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:49,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:49,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:49,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,866 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:49,866 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:49,866 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:49,866 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:49,867 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,867 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,885 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,885 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:49,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:49,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:49,886 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:49,886 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,888 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,889 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:03:49,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:49,889 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:49,889 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:49,889 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:49,889 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:49,889 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:49,889 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:49,890 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:49,890 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:03:49,910 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ca65e4909084473d8263c3bb5c896c03 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201ca65e4909084473d8263c3bb5c896c03 2023-02-13 12:03:50,319 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/95f52ac31cba48249d28e1792cf925cc 2023-02-13 12:03:50,332 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/95f52ac31cba48249d28e1792cf925cc as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95f52ac31cba48249d28e1792cf925cc 2023-02-13 12:03:50,339 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95f52ac31cba48249d28e1792cf925cc, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 12:03:50,339 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 449ms, sequenceid=13, compaction requested=true 2023-02-13 12:03:50,340 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:50,340 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:50,340 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:50,340 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:50,340 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,340 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:50,340 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:50,368 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,368 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:50,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:50,368 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:50,368 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:50,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:50,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:50,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:50,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@630023a2[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:50,370 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:50,370 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,376 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,376 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:50,376 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:50,376 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:50,377 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,377 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:50,384 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:50,384 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:50,385 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:50,384 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:50,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:50,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:50,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:50,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:50,389 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:50,390 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:50,390 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:50,390 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,390 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:50,401 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,401 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:50,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:50,401 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:50,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:50,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:50,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:50,403 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:50,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,406 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:50,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,418 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,418 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,418 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:50,418 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:50,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:50,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:50,418 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:50,418 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:50,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:50,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:03:50,419 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:50,419 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,419 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:50,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:50,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:50,420 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,420 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,420 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,520 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:50,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:50,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:50,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:50,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,525 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:50,525 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:50,525 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:50,525 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:50,526 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,526 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,534 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:50,534 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:50,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:50,535 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:50,535 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:50,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:50,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,536 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,536 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:03:50,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:50,536 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:50,536 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:50,536 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:50,536 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:50,536 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:50,536 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:50,536 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:50,536 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:03:50,952 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120582f9d5bd0e9743eab306a5f705d56768 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120582f9d5bd0e9743eab306a5f705d56768 2023-02-13 12:03:51,360 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/ca5e4390b05d42349195b87d5acecec5 2023-02-13 12:03:51,373 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/ca5e4390b05d42349195b87d5acecec5 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/ca5e4390b05d42349195b87d5acecec5 2023-02-13 12:03:51,378 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/ca5e4390b05d42349195b87d5acecec5, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 12:03:51,379 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 843ms, sequenceid=17, compaction requested=true 2023-02-13 12:03:51,379 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:51,379 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:51,379 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:51,379 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:51,379 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,379 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:51,379 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:51,410 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:51,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:51,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,410 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:51,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:51,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76ed291a[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:51,414 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:51,415 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,424 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,425 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:51,425 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:51,425 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:51,425 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,425 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:51,435 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,435 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:51,435 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:51,435 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:51,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:51,444 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:51,444 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:51,444 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:51,444 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,445 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:51,451 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,451 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:51,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:51,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,451 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:51,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:51,452 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:51,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:51,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:51,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,454 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:51,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,466 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,466 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:51,466 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:51,466 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:51,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:51,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:51,466 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:51,466 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,467 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,467 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:51,467 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:51,467 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:51,467 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,467 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,567 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:51,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:51,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,583 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:51,583 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:51,583 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:51,583 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:51,584 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,584 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,593 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,593 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:51,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:51,594 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:51,594 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,597 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,597 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:03:51,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:51,598 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:51,598 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:51,598 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:51,598 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:51,599 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:51,599 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:51,599 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:51,599 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:03:51,615 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228840c82f5af6d4094a56b1be8e6dba377 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228840c82f5af6d4094a56b1be8e6dba377 2023-02-13 12:03:52,022 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/34221df31ff34626a150529777225fb8 2023-02-13 12:03:52,032 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/34221df31ff34626a150529777225fb8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/34221df31ff34626a150529777225fb8 2023-02-13 12:03:52,037 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/34221df31ff34626a150529777225fb8, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 12:03:52,038 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 439ms, sequenceid=21, compaction requested=true 2023-02-13 12:03:52,038 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:52,038 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,068 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:52,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:52,069 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,069 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:52,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:52,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:52,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:52,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:52,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4721bfe7[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:52,072 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:52,073 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,083 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,083 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:52,083 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:52,083 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:52,083 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,083 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:52,093 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:52,093 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,093 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:52,093 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:52,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:52,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:52,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:52,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:52,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:52,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:52,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:52,103 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:52,103 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:52,103 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:52,104 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,104 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:52,169 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,169 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,169 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:52,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:52,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:52,171 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:52,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:52,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,176 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:52,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,190 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,190 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:52,190 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:52,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:03:52,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:52,190 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,191 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,191 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,191 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:52,191 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:52,191 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:52,190 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:52,190 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:52,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:52,191 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:52,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:52,291 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:52,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:52,302 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:03:52,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:52,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:52,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,306 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:52,306 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:52,306 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:52,306 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:52,307 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,307 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,315 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,315 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:52,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:52,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:52,315 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:52,315 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:03:52,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:52,316 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:52,316 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:52,316 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:52,317 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:52,317 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:52,317 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:52,317 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:52,317 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:03:52,733 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319ee5e9fe89a6490d8aad2e0670f0ace3 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319ee5e9fe89a6490d8aad2e0670f0ace3 2023-02-13 12:03:53,141 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/56bc4d3d6d1e480f81e9e0d4d59f472b 2023-02-13 12:03:53,151 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/56bc4d3d6d1e480f81e9e0d4d59f472b as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/56bc4d3d6d1e480f81e9e0d4d59f472b 2023-02-13 12:03:53,156 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/56bc4d3d6d1e480f81e9e0d4d59f472b, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 12:03:53,157 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 840ms, sequenceid=25, compaction requested=true 2023-02-13 12:03:53,157 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:53,157 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:53,157 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:53,157 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:53,157 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,157 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:53,157 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:53,188 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,188 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:53,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:53,189 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,189 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:53,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:53,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:53,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:53,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66625269[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:53,193 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:53,193 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,199 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,199 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:53,199 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:53,199 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:53,199 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,199 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:53,207 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:53,207 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:53,207 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:53,207 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:53,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:53,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:53,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:53,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:53,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:53,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:53,216 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:53,216 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:53,216 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:53,216 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,217 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:53,223 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,223 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:53,224 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:53,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:53,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:53,225 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:53,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:53,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,226 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:53,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,238 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:53,238 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,238 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,238 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,238 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:03:53,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:53,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:53,238 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:53,238 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:53,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:53,238 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:53,239 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,239 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:53,239 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,239 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:53,340 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:53,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:53,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:53,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:53,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,354 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:53,354 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:53,354 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:53,354 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:53,355 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,355 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,365 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:53,365 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:53,366 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,366 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,368 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,369 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:03:53,369 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,369 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:53,369 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:53,369 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:53,369 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:53,370 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:53,370 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:53,370 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:53,370 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:03:53,795 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018a77024f935740819ef3d23ab8a6bf90 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018a77024f935740819ef3d23ab8a6bf90 2023-02-13 12:03:53,803 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/95fb514e2bc0457289b7656d1cdcbe74 2023-02-13 12:03:53,809 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/95fb514e2bc0457289b7656d1cdcbe74 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95fb514e2bc0457289b7656d1cdcbe74 2023-02-13 12:03:53,815 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95fb514e2bc0457289b7656d1cdcbe74, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 12:03:53,816 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 446ms, sequenceid=29, compaction requested=true 2023-02-13 12:03:53,816 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:53,817 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:53,817 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:53,817 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:53,817 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,817 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:53,817 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:53,854 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,855 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:53,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:53,855 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,856 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:53,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:53,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:53,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:53,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41d7034[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:53,861 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:53,862 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,871 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,872 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:53,872 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:53,872 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:53,872 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,872 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:53,882 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:53,882 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:53,882 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:53,882 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:53,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:53,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:53,893 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:53,893 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:53,893 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:53,893 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,893 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:53,904 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,905 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,905 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:53,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:53,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:53,906 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:53,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:53,910 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:53,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,923 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,923 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:53,923 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:53,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:53,923 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,924 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:53,924 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,924 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,924 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:53,924 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:53,924 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:53,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:53,923 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:53,923 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:53,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:53,924 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:03:53,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:53,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:54,024 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:54,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:54,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:54,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:54,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,035 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:54,035 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:54,036 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:54,036 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:54,036 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,036 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,046 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:54,046 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:54,047 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,047 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:54,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:54,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:03:54,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,050 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:54,050 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:54,050 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:54,050 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:54,050 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:54,050 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:54,050 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:54,050 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:03:54,471 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103462c2aa9b1bf4de1bf16a7fd04197623 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103462c2aa9b1bf4de1bf16a7fd04197623 2023-02-13 12:03:54,879 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/014bb060133b4fc3889bd0bd5c6f96d7 2023-02-13 12:03:54,889 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/014bb060133b4fc3889bd0bd5c6f96d7 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/014bb060133b4fc3889bd0bd5c6f96d7 2023-02-13 12:03:54,895 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/014bb060133b4fc3889bd0bd5c6f96d7, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 12:03:54,896 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 846ms, sequenceid=33, compaction requested=true 2023-02-13 12:03:54,896 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:54,896 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:54,896 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:54,896 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:54,896 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,897 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:54,897 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:54,938 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,938 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:54,938 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,938 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:54,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:54,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:54,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ba72c54[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:54,942 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:54,942 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,948 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,949 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:54,949 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:54,949 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:54,949 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,949 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:54,987 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,987 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:54,987 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:54,987 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:54,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:54,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:54,996 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:54,996 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:54,997 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:54,997 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:54,997 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:55,013 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,013 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:55,013 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:55,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:55,015 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:55,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,019 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:55,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:55,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:55,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:55,032 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:55,032 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,032 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,032 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:55,032 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:55,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:55,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:55,032 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:55,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:55,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:55,032 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:55,033 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:55,033 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:55,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:03:55,033 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:55,033 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:55,033 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,133 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:55,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:55,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:55,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:55,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,148 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:55,148 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:55,148 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:55,148 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:55,148 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,148 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,157 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:55,157 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:55,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:55,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:55,157 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:55,158 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:55,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:55,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,159 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,160 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:03:55,160 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:55,160 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:55,160 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:55,160 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:55,161 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:55,161 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:55,161 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:55,161 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:55,161 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:03:55,580 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090781b1d727fe8d41c1b72548e80e532066 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090781b1d727fe8d41c1b72548e80e532066 2023-02-13 12:03:55,987 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/2b09830081c8472f9bed74b5d3052550 2023-02-13 12:03:55,991 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/2b09830081c8472f9bed74b5d3052550 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/2b09830081c8472f9bed74b5d3052550 2023-02-13 12:03:55,995 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/2b09830081c8472f9bed74b5d3052550, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 12:03:55,995 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 834ms, sequenceid=37, compaction requested=true 2023-02-13 12:03:55,995 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:55,995 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:55,995 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:55,996 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:55,996 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:55,996 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:55,996 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:56,029 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,029 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:56,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:56,030 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,030 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:56,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:56,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:56,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:56,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:56,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51337640[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:56,031 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:56,032 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,040 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,040 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:56,040 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:56,040 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:56,040 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,040 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:56,048 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:56,048 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:56,048 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,048 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:56,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:56,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:56,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:56,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:56,052 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:56,053 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:56,053 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:56,053 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,053 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:56,062 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,062 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,063 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:56,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:56,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:56,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:56,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:56,063 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:56,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,065 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,073 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,073 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:56,073 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:56,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:56,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 12:03:56,074 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,074 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:56,074 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:56,074 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:56,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:56,074 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:56,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:56,074 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,075 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,075 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,075 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:56,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:56,174 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:56,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:56,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:03:56,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 12:03:56,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,189 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:56,189 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:56,189 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 12:03:56,189 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 12:03:56,190 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,190 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,199 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:56,199 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:56,200 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:56,200 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:03:56,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:03:56,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,203 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 12:03:56,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:56,204 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 12:03:56,204 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:03:56,204 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 12:03:56,205 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 12:03:56,205 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:03:56,205 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:56,205 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. started... 2023-02-13 12:03:56,205 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 98ea924bbcf091ddc51e5c75dcdfc0b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 12:03:56,626 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112086867c4cb9aa4ccbab97c453d85188e6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112086867c4cb9aa4ccbab97c453d85188e6 2023-02-13 12:03:57,033 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/57d7ad3891474b6498487e8af26c02d5 2023-02-13 12:03:57,045 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/57d7ad3891474b6498487e8af26c02d5 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/57d7ad3891474b6498487e8af26c02d5 2023-02-13 12:03:57,050 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/57d7ad3891474b6498487e8af26c02d5, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 12:03:57,051 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98ea924bbcf091ddc51e5c75dcdfc0b7 in 846ms, sequenceid=41, compaction requested=true 2023-02-13 12:03:57,051 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:57,051 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:57,051 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 12:03:57,051 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 12:03:57,051 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,051 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 12:03:57,051 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 12:03:57,088 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,088 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:57,088 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,089 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:03:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:57,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:57,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 12:03:57,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25b69715[Count = 0] remaining members to acquire global barrier 2023-02-13 12:03:57,092 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 12:03:57,093 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,098 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,099 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 12:03:57,099 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 12:03:57,099 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,099 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:03:57,099 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:03:57,106 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,107 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 12:03:57,107 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:57,107 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 12:03:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:57,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:03:57,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 12:03:57,109 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 12:03:57,109 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:03:57,109 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:03:57,109 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,109 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:03:57,115 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,115 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:03:57,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:03:57,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,115 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:57,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:03:57,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:57,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:57,116 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:03:57,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,116 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:03:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,123 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,123 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:03:57,123 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:03:57,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 12:03:57,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:03:57,123 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:03:57,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:03:57,123 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:03:57,123 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,123 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:03:57,123 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,123 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 12:03:57,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:03:57,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:03:57,123 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,124 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:03:57,124 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,224 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:03:57,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:03:57,240 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-13 12:03:57,243 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:03:57,244 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:03:57,245 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:03:57,245 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290437245 2023-02-13 12:03:57,248 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 12:03:57,250 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 12:03:57,250 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:03:57,251 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x33aa1422 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:03:57,263 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64aae61d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:03:57,264 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:03:58,100 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b1261dd360d8441cbfb27883668504a8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b1261dd360d8441cbfb27883668504a8 2023-02-13 12:03:58,100 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:03:58,111 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:03:58,113 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:38044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:03:58,119 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:03:58,120 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47100, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:03:58,128 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/eca383fc57374545b5afcf6621214f77 first=Optional[r5] last=Optional[r6] 2023-02-13 12:03:58,128 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/eca383fc57374545b5afcf6621214f77}] 2023-02-13 12:03:58,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/eca383fc57374545b5afcf6621214f77 for inclusion in 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 2023-02-13 12:03:58,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 12:03:58,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:03:58,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:58,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/eca383fc57374545b5afcf6621214f77 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5bbsn5kkjo2qdio30p4ehpbp7i7i9ua084v2ml67u5r9mbffap6op1ptpc74qf8t/family1/eca383fc57374545b5afcf6621214f77 2023-02-13 12:03:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5bbsn5kkjo2qdio30p4ehpbp7i7i9ua084v2ml67u5r9mbffap6op1ptpc74qf8t/family1/eca383fc57374545b5afcf6621214f77 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/48ce8fef13b547d5aa967a844eca4ff6_SeqId_44_ 2023-02-13 12:03:58,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5bbsn5kkjo2qdio30p4ehpbp7i7i9ua084v2ml67u5r9mbffap6op1ptpc74qf8t/family1/eca383fc57374545b5afcf6621214f77 into 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/48ce8fef13b547d5aa967a844eca4ff6_SeqId_44_ - updating store file list. 2023-02-13 12:03:58,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/48ce8fef13b547d5aa967a844eca4ff6_SeqId_44_ into 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 2023-02-13 12:03:58,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5bbsn5kkjo2qdio30p4ehpbp7i7i9ua084v2ml67u5r9mbffap6op1ptpc74qf8t/family1/eca383fc57374545b5afcf6621214f77 into 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/48ce8fef13b547d5aa967a844eca4ff6_SeqId_44_) 2023-02-13 12:03:58,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5bbsn5kkjo2qdio30p4ehpbp7i7i9ua084v2ml67u5r9mbffap6op1ptpc74qf8t/family1/eca383fc57374545b5afcf6621214f77 2023-02-13 12:03:58,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 12:03:58,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 12:03:58,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 is initiating minor compaction 2023-02-13 12:03:58,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@65d3d8b8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:03:58,144 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 in testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:58,144 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/8ba168acba6c4457a8fde6e42153f741, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95f52ac31cba48249d28e1792cf925cc, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/ca5e4390b05d42349195b87d5acecec5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/34221df31ff34626a150529777225fb8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/56bc4d3d6d1e480f81e9e0d4d59f472b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95fb514e2bc0457289b7656d1cdcbe74, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/014bb060133b4fc3889bd0bd5c6f96d7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/2b09830081c8472f9bed74b5d3052550, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/57d7ad3891474b6498487e8af26c02d5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/48ce8fef13b547d5aa967a844eca4ff6_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp, totalSize=49.7 K 2023-02-13 12:03:58,144 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 8ba168acba6c4457a8fde6e42153f741, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 12:03:58,144 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 95f52ac31cba48249d28e1792cf925cc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 12:03:58,144 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting ca5e4390b05d42349195b87d5acecec5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 12:03:58,144 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 34221df31ff34626a150529777225fb8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 12:03:58,145 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 56bc4d3d6d1e480f81e9e0d4d59f472b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 12:03:58,145 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 95fb514e2bc0457289b7656d1cdcbe74, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 12:03:58,145 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 014bb060133b4fc3889bd0bd5c6f96d7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 12:03:58,145 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 2b09830081c8472f9bed74b5d3052550, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 12:03:58,145 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 57d7ad3891474b6498487e8af26c02d5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 12:03:58,145 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] compactions.Compactor(207): Compacting 48ce8fef13b547d5aa967a844eca4ff6_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 12:03:58,147 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:03:58,147 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:58,148 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018a77024f935740819ef3d23ab8a6bf90 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018a77024f935740819ef3d23ab8a6bf90 2023-02-13 12:03:58,149 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103462c2aa9b1bf4de1bf16a7fd04197623 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103462c2aa9b1bf4de1bf16a7fd04197623 2023-02-13 12:03:58,150 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 12:03:58,150 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 12:03:58,150 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:03:58,150 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:03:58,176 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] throttle.PressureAwareThroughputController(145): 98ea924bbcf091ddc51e5c75dcdfc0b7#family1#compaction#166 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:58,611 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123102d98aec3d0b43359012a0c4d530da12 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123102d98aec3d0b43359012a0c4d530da12 2023-02-13 12:03:58,613 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:03:58,635 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/46651e1d103742ff9b686eece0348924 first=Optional[r1] last=Optional[r4] 2023-02-13 12:03:58,635 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/46651e1d103742ff9b686eece0348924}] 2023-02-13 12:03:58,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/46651e1d103742ff9b686eece0348924 for inclusion in 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 2023-02-13 12:03:58,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 12:03:58,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:03:58,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:58,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/46651e1d103742ff9b686eece0348924 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4usjpnm2n0ce1tbbmtatpjbqmea6e6g01dc5k21vq8gcbql6a30084o59agqbjls/family1/46651e1d103742ff9b686eece0348924 2023-02-13 12:03:58,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4usjpnm2n0ce1tbbmtatpjbqmea6e6g01dc5k21vq8gcbql6a30084o59agqbjls/family1/46651e1d103742ff9b686eece0348924 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/315446c3496d4ce78bce06b767de44db_SeqId_46_ 2023-02-13 12:03:58,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4usjpnm2n0ce1tbbmtatpjbqmea6e6g01dc5k21vq8gcbql6a30084o59agqbjls/family1/46651e1d103742ff9b686eece0348924 into 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/315446c3496d4ce78bce06b767de44db_SeqId_46_ - updating store file list. 2023-02-13 12:03:58,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/315446c3496d4ce78bce06b767de44db_SeqId_46_ into 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 2023-02-13 12:03:58,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4usjpnm2n0ce1tbbmtatpjbqmea6e6g01dc5k21vq8gcbql6a30084o59agqbjls/family1/46651e1d103742ff9b686eece0348924 into 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/315446c3496d4ce78bce06b767de44db_SeqId_46_) 2023-02-13 12:03:58,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4usjpnm2n0ce1tbbmtatpjbqmea6e6g01dc5k21vq8gcbql6a30084o59agqbjls/family1/46651e1d103742ff9b686eece0348924 2023-02-13 12:03:58,647 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:03:58,647 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:58,648 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201ca65e4909084473d8263c3bb5c896c03 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201ca65e4909084473d8263c3bb5c896c03 2023-02-13 12:03:58,649 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120582f9d5bd0e9743eab306a5f705d56768 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120582f9d5bd0e9743eab306a5f705d56768 2023-02-13 12:03:58,650 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228840c82f5af6d4094a56b1be8e6dba377 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228840c82f5af6d4094a56b1be8e6dba377 2023-02-13 12:03:58,651 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319ee5e9fe89a6490d8aad2e0670f0ace3 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319ee5e9fe89a6490d8aad2e0670f0ace3 2023-02-13 12:03:58,651 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 12:03:58,651 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 12:03:58,652 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:03:58,652 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:03:59,006 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/4ea6f9c638094faba99109c33fb29a0e as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/4ea6f9c638094faba99109c33fb29a0e 2023-02-13 12:03:59,013 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 of 98ea924bbcf091ddc51e5c75dcdfc0b7 into 4ea6f9c638094faba99109c33fb29a0e(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:03:59,013 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:59,013 INFO [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676289838144; duration=0sec 2023-02-13 12:03:59,013 DEBUG [RS:0;jenkins-hbase16:39857-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:03:59,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/8ba168acba6c4457a8fde6e42153f741, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95f52ac31cba48249d28e1792cf925cc, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/ca5e4390b05d42349195b87d5acecec5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/34221df31ff34626a150529777225fb8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/56bc4d3d6d1e480f81e9e0d4d59f472b, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95fb514e2bc0457289b7656d1cdcbe74, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/014bb060133b4fc3889bd0bd5c6f96d7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/2b09830081c8472f9bed74b5d3052550, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/57d7ad3891474b6498487e8af26c02d5, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/48ce8fef13b547d5aa967a844eca4ff6_SeqId_44_] to archive 2023-02-13 12:03:59,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:59,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/8ba168acba6c4457a8fde6e42153f741 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/8ba168acba6c4457a8fde6e42153f741 2023-02-13 12:03:59,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95f52ac31cba48249d28e1792cf925cc to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95f52ac31cba48249d28e1792cf925cc 2023-02-13 12:03:59,084 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b6480bd473274e599ba15e05b0bf15d0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b6480bd473274e599ba15e05b0bf15d0 2023-02-13 12:03:59,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/ca5e4390b05d42349195b87d5acecec5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/ca5e4390b05d42349195b87d5acecec5 2023-02-13 12:03:59,085 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:03:59,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/34221df31ff34626a150529777225fb8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/34221df31ff34626a150529777225fb8 2023-02-13 12:03:59,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/56bc4d3d6d1e480f81e9e0d4d59f472b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/56bc4d3d6d1e480f81e9e0d4d59f472b 2023-02-13 12:03:59,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95fb514e2bc0457289b7656d1cdcbe74 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/95fb514e2bc0457289b7656d1cdcbe74 2023-02-13 12:03:59,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/014bb060133b4fc3889bd0bd5c6f96d7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/014bb060133b4fc3889bd0bd5c6f96d7 2023-02-13 12:03:59,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/2b09830081c8472f9bed74b5d3052550 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/2b09830081c8472f9bed74b5d3052550 2023-02-13 12:03:59,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/57d7ad3891474b6498487e8af26c02d5 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/57d7ad3891474b6498487e8af26c02d5 2023-02-13 12:03:59,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/48ce8fef13b547d5aa967a844eca4ff6_SeqId_44_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/48ce8fef13b547d5aa967a844eca4ff6_SeqId_44_ 2023-02-13 12:03:59,108 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/438bb9862994431e890401cf7a4a62c3 first=Optional[r00] last=Optional[r8] 2023-02-13 12:03:59,109 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/438bb9862994431e890401cf7a4a62c3}] 2023-02-13 12:03:59,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/438bb9862994431e890401cf7a4a62c3 for inclusion in 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 2023-02-13 12:03:59,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 12:03:59,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 12:03:59,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:03:59,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/438bb9862994431e890401cf7a4a62c3 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16jd0n1mqiokj59mfvuc43v35v47qg8t69m2trbitav6mag112q8vo4re1u2gps/family1/438bb9862994431e890401cf7a4a62c3 2023-02-13 12:03:59,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16jd0n1mqiokj59mfvuc43v35v47qg8t69m2trbitav6mag112q8vo4re1u2gps/family1/438bb9862994431e890401cf7a4a62c3 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/772256f7dafb4f2d94664a7d2fbea149_SeqId_49_ 2023-02-13 12:03:59,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16jd0n1mqiokj59mfvuc43v35v47qg8t69m2trbitav6mag112q8vo4re1u2gps/family1/438bb9862994431e890401cf7a4a62c3 into 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/772256f7dafb4f2d94664a7d2fbea149_SeqId_49_ - updating store file list. 2023-02-13 12:03:59,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/772256f7dafb4f2d94664a7d2fbea149_SeqId_49_ into 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 2023-02-13 12:03:59,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16jd0n1mqiokj59mfvuc43v35v47qg8t69m2trbitav6mag112q8vo4re1u2gps/family1/438bb9862994431e890401cf7a4a62c3 into 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/772256f7dafb4f2d94664a7d2fbea149_SeqId_49_) 2023-02-13 12:03:59,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16jd0n1mqiokj59mfvuc43v35v47qg8t69m2trbitav6mag112q8vo4re1u2gps/family1/438bb9862994431e890401cf7a4a62c3 2023-02-13 12:03:59,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 12:03:59,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 12:03:59,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(1912): 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 is initiating minor compaction (all files) 2023-02-13 12:03:59,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6de78b07; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:03:59,123 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 in testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:03:59,123 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/1d4dbf6f356b43df83900cf69ba0ee51, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/4ea6f9c638094faba99109c33fb29a0e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/315446c3496d4ce78bce06b767de44db_SeqId_46_, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/772256f7dafb4f2d94664a7d2fbea149_SeqId_49_] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp, totalSize=344.3 K 2023-02-13 12:03:59,123 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 1d4dbf6f356b43df83900cf69ba0ee51, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807319 2023-02-13 12:03:59,124 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 4ea6f9c638094faba99109c33fb29a0e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207319 2023-02-13 12:03:59,124 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 315446c3496d4ce78bce06b767de44db_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965207319 2023-02-13 12:03:59,124 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] compactions.Compactor(207): Compacting 772256f7dafb4f2d94664a7d2fbea149_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014807319 2023-02-13 12:03:59,124 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:03:59,125 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:03:59,126 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112086867c4cb9aa4ccbab97c453d85188e6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112086867c4cb9aa4ccbab97c453d85188e6 2023-02-13 12:03:59,127 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511283fa66ff18e2e4b13b88bf18500f82f20 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511283fa66ff18e2e4b13b88bf18500f82f20 2023-02-13 12:03:59,128 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511303e4dd549a4e647dbaca4f7c28b976409 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511303e4dd549a4e647dbaca4f7c28b976409 2023-02-13 12:03:59,128 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 12:03:59,128 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 12:03:59,129 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:03:59,129 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:03:59,129 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 12:03:59,129 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 12:03:59,129 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:03:59,131 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 12:03:59,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8900 sec 2023-02-13 12:03:59,143 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] throttle.PressureAwareThroughputController(145): 98ea924bbcf091ddc51e5c75dcdfc0b7#family1#compaction#167 average throughput is 17.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:03:59,242 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=258 (was 248) - Thread LEAK? -, OpenFileDescriptor=645 (was 612) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=91 (was 46) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=5944 (was 5947) 2023-02-13 12:03:59,255 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=258, OpenFileDescriptor=645, MaxFileDescriptor=60000, SystemLoadAverage=91, ProcessCount=165, AvailableMemoryMB=5943 2023-02-13 12:03:59,273 DEBUG [Listener at localhost.localdomain/40603] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-13 12:03:59,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.HMaster$4(2102): Client=jenkins//188.40.62.62 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC0Y:\xE8\x98\x09=\xCA{\xA2\xAD\xB0\x1C\xDA\xD2\x8F"\x10\xE9\x05\x0A\xB8\xF5\x12\xF5|\xDE:9\xEBy\x87Fb*\x10\x02\x0F\xD7\xF3,\x7F$\x05\xE5f\x03\x92w\xA9Yp2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 12:03:59,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-13 12:03:59,316 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 12:03:59,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(697): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-13 12:03:59,316 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 12:03:59,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 12:03:59,318 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:03:59,318 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:03:59,318 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:03:59,319 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de empty. 2023-02-13 12:03:59,319 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba empty. 2023-02-13 12:03:59,319 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1 empty. 2023-02-13 12:03:59,319 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:03:59,319 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:03:59,319 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:03:59,319 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-13 12:03:59,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 12:03:59,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 12:03:59,729 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-13 12:03:59,732 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 60a9b9bc2aa1d9558d235def779498de, NAME => 'testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC0Y:\xE8\x98\x09=\xCA{\xA2\xAD\xB0\x1C\xDA\xD2\x8F"\x10\xE9\x05\x0A\xB8\xF5\x12\xF5|\xDE:9\xEBy\x87Fb*\x10\x02\x0F\xD7\xF3,\x7F$\x05\xE5f\x03\x92w\xA9Yp2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:03:59,733 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => d6aaa8cbc07ce7f34bfac7a7da7460ba, NAME => 'testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC0Y:\xE8\x98\x09=\xCA{\xA2\xAD\xB0\x1C\xDA\xD2\x8F"\x10\xE9\x05\x0A\xB8\xF5\x12\xF5|\xDE:9\xEBy\x87Fb*\x10\x02\x0F\xD7\xF3,\x7F$\x05\xE5f\x03\x92w\xA9Yp2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:03:59,734 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 21af9b0de93a32d4dff1e415280782a1, NAME => 'testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC0Y:\xE8\x98\x09=\xCA{\xA2\xAD\xB0\x1C\xDA\xD2\x8F"\x10\xE9\x05\x0A\xB8\xF5\x12\xF5|\xDE:9\xEBy\x87Fb*\x10\x02\x0F\xD7\xF3,\x7F$\x05\xE5f\x03\x92w\xA9Yp2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/.tmp 2023-02-13 12:03:59,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 12:04:00,143 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:04:00,143 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:04:00,143 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:04:00,143 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing d6aaa8cbc07ce7f34bfac7a7da7460ba, disabling compactions & flushes 2023-02-13 12:04:00,144 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 21af9b0de93a32d4dff1e415280782a1, disabling compactions & flushes 2023-02-13 12:04:00,144 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:00,144 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:00,144 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. after waiting 0 ms 2023-02-13 12:04:00,144 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 60a9b9bc2aa1d9558d235def779498de, disabling compactions & flushes 2023-02-13 12:04:00,145 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:00,145 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:00,144 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:00,145 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 21af9b0de93a32d4dff1e415280782a1: Waiting for close lock at 1676289840144Disabling compacts and flushes for region at 1676289840144Disabling writes for close at 1676289840145 (+1 ms)Writing region close event to WAL at 1676289840145Closed at 1676289840145 2023-02-13 12:04:00,145 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:00,146 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:00,146 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. after waiting 0 ms 2023-02-13 12:04:00,146 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:00,146 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:00,146 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 60a9b9bc2aa1d9558d235def779498de: Waiting for close lock at 1676289840144Disabling compacts and flushes for region at 1676289840144Disabling writes for close at 1676289840146 (+2 ms)Writing region close event to WAL at 1676289840146Closed at 1676289840146 2023-02-13 12:04:00,145 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:00,146 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. after waiting 0 ms 2023-02-13 12:04:00,146 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:00,147 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:00,147 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: Waiting for close lock at 1676289840143Disabling compacts and flushes for region at 1676289840143Disabling writes for close at 1676289840146 (+3 ms)Writing region close event to WAL at 1676289840147 (+1 ms)Closed at 1676289840147 2023-02-13 12:04:00,152 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 12:04:00,154 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676289840154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289840154"}]},"ts":"1676289840154"} 2023-02-13 12:04:00,154 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289840154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289840154"}]},"ts":"1676289840154"} 2023-02-13 12:04:00,154 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289840154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676289840154"}]},"ts":"1676289840154"} 2023-02-13 12:04:00,156 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 12:04:00,156 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 12:04:00,156 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289840156"}]},"ts":"1676289840156"} 2023-02-13 12:04:00,157 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-13 12:04:00,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=60a9b9bc2aa1d9558d235def779498de, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=21af9b0de93a32d4dff1e415280782a1, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d6aaa8cbc07ce7f34bfac7a7da7460ba, ASSIGN}] 2023-02-13 12:04:00,207 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d6aaa8cbc07ce7f34bfac7a7da7460ba, ASSIGN 2023-02-13 12:04:00,207 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=21af9b0de93a32d4dff1e415280782a1, ASSIGN 2023-02-13 12:04:00,207 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=60a9b9bc2aa1d9558d235def779498de, ASSIGN 2023-02-13 12:04:00,208 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d6aaa8cbc07ce7f34bfac7a7da7460ba, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:04:00,208 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=21af9b0de93a32d4dff1e415280782a1, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:04:00,208 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=60a9b9bc2aa1d9558d235def779498de, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,39857,1676289663697; forceNewPlan=false, retain=false 2023-02-13 12:04:00,361 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=60a9b9bc2aa1d9558d235def779498de, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:00,361 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=d6aaa8cbc07ce7f34bfac7a7da7460ba, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:00,361 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=21af9b0de93a32d4dff1e415280782a1, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:00,362 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289840361"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289840361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289840361"}]},"ts":"1676289840361"} 2023-02-13 12:04:00,362 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676289840361"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289840361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289840361"}]},"ts":"1676289840361"} 2023-02-13 12:04:00,362 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289840361"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676289840361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676289840361"}]},"ts":"1676289840361"} 2023-02-13 12:04:00,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure d6aaa8cbc07ce7f34bfac7a7da7460ba, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:04:00,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 21af9b0de93a32d4dff1e415280782a1, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:04:00,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 60a9b9bc2aa1d9558d235def779498de, server=jenkins-hbase16.apache.org,39857,1676289663697}] 2023-02-13 12:04:00,376 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/.tmp/family1/6bcd9f78aaf44c36a6ee92c01e8afd94 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/6bcd9f78aaf44c36a6ee92c01e8afd94 2023-02-13 12:04:00,380 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 98ea924bbcf091ddc51e5c75dcdfc0b7/family1 of 98ea924bbcf091ddc51e5c75dcdfc0b7 into 6bcd9f78aaf44c36a6ee92c01e8afd94(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:04:00,380 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: 2023-02-13 12:04:00,380 INFO [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1676289839123; duration=1sec 2023-02-13 12:04:00,380 DEBUG [RS:0;jenkins-hbase16:39857-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 12:04:00,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 12:04:00,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/1d4dbf6f356b43df83900cf69ba0ee51, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/4ea6f9c638094faba99109c33fb29a0e, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/315446c3496d4ce78bce06b767de44db_SeqId_46_, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/772256f7dafb4f2d94664a7d2fbea149_SeqId_49_] to archive 2023-02-13 12:04:00,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:00,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/1d4dbf6f356b43df83900cf69ba0ee51 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/1d4dbf6f356b43df83900cf69ba0ee51 2023-02-13 12:04:00,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/4ea6f9c638094faba99109c33fb29a0e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/4ea6f9c638094faba99109c33fb29a0e 2023-02-13 12:04:00,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/315446c3496d4ce78bce06b767de44db_SeqId_46_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/315446c3496d4ce78bce06b767de44db_SeqId_46_ 2023-02-13 12:04:00,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/772256f7dafb4f2d94664a7d2fbea149_SeqId_49_ to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/family1/772256f7dafb4f2d94664a7d2fbea149_SeqId_49_ 2023-02-13 12:04:00,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:00,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d6aaa8cbc07ce7f34bfac7a7da7460ba, NAME => 'testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 12:04:00,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:04:00,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:04:00,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:04:00,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:04:00,546 INFO [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:04:00,547 DEBUG [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1 2023-02-13 12:04:00,547 DEBUG [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1 2023-02-13 12:04:00,548 INFO [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6aaa8cbc07ce7f34bfac7a7da7460ba columnFamilyName family1 2023-02-13 12:04:00,549 INFO [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] regionserver.HStore(310): Store=d6aaa8cbc07ce7f34bfac7a7da7460ba/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:04:00,549 INFO [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:04:00,550 DEBUG [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2 2023-02-13 12:04:00,550 DEBUG [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2 2023-02-13 12:04:00,550 INFO [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6aaa8cbc07ce7f34bfac7a7da7460ba columnFamilyName family2 2023-02-13 12:04:00,551 INFO [StoreOpener-d6aaa8cbc07ce7f34bfac7a7da7460ba-1] regionserver.HStore(310): Store=d6aaa8cbc07ce7f34bfac7a7da7460ba/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:04:00,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:04:00,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:04:00,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:04:00,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:04:00,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:04:00,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened d6aaa8cbc07ce7f34bfac7a7da7460ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69828305, jitterRate=0.040522828698158264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:04:00,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: Running coprocessor pre-open hook at 1676289840523Writing region info on filesystem at 1676289840523Initializing all the Stores at 1676289840525 (+2 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC0Y:\xE8\x98\x09=\xCA{\xA2\xAD\xB0\x1C\xDA\xD2\x8F"\x10\xE9\x05\x0A\xB8\xF5\x12\xF5|\xDE:9\xEBy\x87Fb*\x10\x02\x0F\xD7\xF3,\x7F$\x05\xE5f\x03\x92w\xA9Yp2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289840525Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289840525Cleaning up temporary data from old regions at 1676289840553 (+28 ms)Cleaning up detritus from prior splits at 1676289840553Running coprocessor post-open hooks at 1676289840555 (+2 ms)Region opened successfully at 1676289840555 2023-02-13 12:04:00,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba., pid=120, masterSystemTime=1676289840518 2023-02-13 12:04:00,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:00,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:00,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:00,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 21af9b0de93a32d4dff1e415280782a1, NAME => 'testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 12:04:00,557 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=d6aaa8cbc07ce7f34bfac7a7da7460ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:00,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:04:00,558 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289840557"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289840557"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289840557"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289840557"}]},"ts":"1676289840557"} 2023-02-13 12:04:00,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:04:00,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:04:00,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:04:00,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-02-13 12:04:00,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure d6aaa8cbc07ce7f34bfac7a7da7460ba, server=jenkins-hbase16.apache.org,39857,1676289663697 in 194 msec 2023-02-13 12:04:00,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d6aaa8cbc07ce7f34bfac7a7da7460ba, ASSIGN in 355 msec 2023-02-13 12:04:00,574 INFO [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:04:00,576 DEBUG [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1 2023-02-13 12:04:00,576 DEBUG [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1 2023-02-13 12:04:00,576 INFO [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21af9b0de93a32d4dff1e415280782a1 columnFamilyName family1 2023-02-13 12:04:00,577 INFO [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] regionserver.HStore(310): Store=21af9b0de93a32d4dff1e415280782a1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:04:00,577 INFO [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:04:00,578 DEBUG [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2 2023-02-13 12:04:00,578 DEBUG [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2 2023-02-13 12:04:00,578 INFO [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21af9b0de93a32d4dff1e415280782a1 columnFamilyName family2 2023-02-13 12:04:00,579 INFO [StoreOpener-21af9b0de93a32d4dff1e415280782a1-1] regionserver.HStore(310): Store=21af9b0de93a32d4dff1e415280782a1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:04:00,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:04:00,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:04:00,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:04:00,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:04:00,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:04:00,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 21af9b0de93a32d4dff1e415280782a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65176020, jitterRate=-0.02880162000656128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:04:00,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 21af9b0de93a32d4dff1e415280782a1: Running coprocessor pre-open hook at 1676289840558Writing region info on filesystem at 1676289840558Initializing all the Stores at 1676289840559 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC0Y:\xE8\x98\x09=\xCA{\xA2\xAD\xB0\x1C\xDA\xD2\x8F"\x10\xE9\x05\x0A\xB8\xF5\x12\xF5|\xDE:9\xEBy\x87Fb*\x10\x02\x0F\xD7\xF3,\x7F$\x05\xE5f\x03\x92w\xA9Yp2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289840559Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289840559Cleaning up temporary data from old regions at 1676289840580 (+21 ms)Cleaning up detritus from prior splits at 1676289840580Running coprocessor post-open hooks at 1676289840583 (+3 ms)Region opened successfully at 1676289840583 2023-02-13 12:04:00,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1., pid=121, masterSystemTime=1676289840518 2023-02-13 12:04:00,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:00,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:00,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:00,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 60a9b9bc2aa1d9558d235def779498de, NAME => 'testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 12:04:00,585 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=21af9b0de93a32d4dff1e415280782a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:00,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:04:00,585 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676289840585"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289840585"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289840585"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289840585"}]},"ts":"1676289840585"} 2023-02-13 12:04:00,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 12:04:00,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7890): checking encryption for 60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:04:00,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7893): checking classloading for 60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:04:00,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-02-13 12:04:00,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 21af9b0de93a32d4dff1e415280782a1, server=jenkins-hbase16.apache.org,39857,1676289663697 in 220 msec 2023-02-13 12:04:00,588 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=21af9b0de93a32d4dff1e415280782a1, ASSIGN in 382 msec 2023-02-13 12:04:00,605 INFO [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:04:00,607 DEBUG [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1 2023-02-13 12:04:00,607 DEBUG [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1 2023-02-13 12:04:00,607 INFO [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60a9b9bc2aa1d9558d235def779498de columnFamilyName family1 2023-02-13 12:04:00,608 INFO [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] regionserver.HStore(310): Store=60a9b9bc2aa1d9558d235def779498de/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:04:00,608 INFO [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:04:00,609 DEBUG [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2 2023-02-13 12:04:00,609 DEBUG [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2 2023-02-13 12:04:00,609 INFO [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60a9b9bc2aa1d9558d235def779498de columnFamilyName family2 2023-02-13 12:04:00,610 INFO [StoreOpener-60a9b9bc2aa1d9558d235def779498de-1] regionserver.HStore(310): Store=60a9b9bc2aa1d9558d235def779498de/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 12:04:00,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:04:00,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:04:00,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 12:04:00,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1054): writing seq id for 60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:04:00,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 12:04:00,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1071): Opened 60a9b9bc2aa1d9558d235def779498de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63681419, jitterRate=-0.05107291042804718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 12:04:00,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(964): Region open journal for 60a9b9bc2aa1d9558d235def779498de: Running coprocessor pre-open hook at 1676289840585Writing region info on filesystem at 1676289840585Initializing all the Stores at 1676289840586 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC0Y:\xE8\x98\x09=\xCA{\xA2\xAD\xB0\x1C\xDA\xD2\x8F"\x10\xE9\x05\x0A\xB8\xF5\x12\xF5|\xDE:9\xEBy\x87Fb*\x10\x02\x0F\xD7\xF3,\x7F$\x05\xE5f\x03\x92w\xA9Yp2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289840586Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676289840586Cleaning up temporary data from old regions at 1676289840611 (+25 ms)Cleaning up detritus from prior splits at 1676289840612 (+1 ms)Running coprocessor post-open hooks at 1676289840614 (+2 ms)Region opened successfully at 1676289840614 2023-02-13 12:04:00,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de., pid=122, masterSystemTime=1676289840518 2023-02-13 12:04:00,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:00,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:00,616 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=60a9b9bc2aa1d9558d235def779498de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:00,616 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676289840616"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676289840616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676289840616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676289840616"}]},"ts":"1676289840616"} 2023-02-13 12:04:00,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-02-13 12:04:00,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 60a9b9bc2aa1d9558d235def779498de, server=jenkins-hbase16.apache.org,39857,1676289663697 in 249 msec 2023-02-13 12:04:00,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-02-13 12:04:00,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=60a9b9bc2aa1d9558d235def779498de, ASSIGN in 414 msec 2023-02-13 12:04:00,621 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 12:04:00,621 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676289840621"}]},"ts":"1676289840621"} 2023-02-13 12:04:00,622 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-13 12:04:00,632 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 12:04:00,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3180 sec 2023-02-13 12:04:01,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 12:04:01,426 INFO [Listener at localhost.localdomain/40603] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-13 12:04:01,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:01,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:01,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:01,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:04:01,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 12:04:01,442 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 12:04:01,443 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:01,443 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 12:04:01,443 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 12:04:01,443 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:01,443 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:01,479 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:01,479 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:01,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:01,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:01,480 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:01,480 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:04:01,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:01,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:04:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:01,482 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 12:04:01,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 12:04:01,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 12:04:01,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:01,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 12:04:01,483 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:01,483 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. started... 2023-02-13 12:04:01,483 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:04:01,484 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:04:01,484 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:01,484 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. started... 2023-02-13 12:04:01,483 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:01,484 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d6aaa8cbc07ce7f34bfac7a7da7460ba 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 12:04:01,485 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 21af9b0de93a32d4dff1e415280782a1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 12:04:01,485 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. started... 2023-02-13 12:04:01,486 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 60a9b9bc2aa1d9558d235def779498de 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 12:04:01,932 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021361502730c96746c5b7ff2f711680f958 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021361502730c96746c5b7ff2f711680f958 2023-02-13 12:04:01,932 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021342d498c25fab4df5810af65df580bca2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021342d498c25fab4df5810af65df580bca2 2023-02-13 12:04:01,936 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302139e1056f177b64a46bdd35e5049d16fb4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139e1056f177b64a46bdd35e5049d16fb4 2023-02-13 12:04:02,346 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/fee691fe2fe64b0ebb92d0e755a64a23 2023-02-13 12:04:02,346 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/93bc74830a414152a722a1a814384101 2023-02-13 12:04:02,350 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/ab758d73c164462caa9cd42d7b8d1d5a 2023-02-13 12:04:02,390 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213d3f5e626973c49a9b6d50ad0792f6039 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3f5e626973c49a9b6d50ad0792f6039 2023-02-13 12:04:02,796 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/3a95140dd3924f848f570532fec6b4d0 2023-02-13 12:04:02,800 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021301bbc8626f1f4f9baeac9c48ef60efff to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023021301bbc8626f1f4f9baeac9c48ef60efff 2023-02-13 12:04:02,800 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213c2555db2ac9c4d0aac250d2edc8849b6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213c2555db2ac9c4d0aac250d2edc8849b6 2023-02-13 12:04:02,801 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/93bc74830a414152a722a1a814384101 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/93bc74830a414152a722a1a814384101 2023-02-13 12:04:02,823 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/93bc74830a414152a722a1a814384101, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 12:04:02,824 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/3a95140dd3924f848f570532fec6b4d0 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/3a95140dd3924f848f570532fec6b4d0 2023-02-13 12:04:02,827 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/3a95140dd3924f848f570532fec6b4d0, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 12:04:02,828 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 21af9b0de93a32d4dff1e415280782a1 in 1343ms, sequenceid=5, compaction requested=false 2023-02-13 12:04:02,828 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-13 12:04:02,829 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 21af9b0de93a32d4dff1e415280782a1: 2023-02-13 12:04:02,829 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:02,829 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:04:03,206 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/cfd03be55903446aa729bc239598a473 2023-02-13 12:04:03,214 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/b78cf5905f7843c78d924aa4f7630548 2023-02-13 12:04:03,217 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/ab758d73c164462caa9cd42d7b8d1d5a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/ab758d73c164462caa9cd42d7b8d1d5a 2023-02-13 12:04:03,220 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/fee691fe2fe64b0ebb92d0e755a64a23 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/fee691fe2fe64b0ebb92d0e755a64a23 2023-02-13 12:04:03,241 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/ab758d73c164462caa9cd42d7b8d1d5a, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 12:04:03,242 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/cfd03be55903446aa729bc239598a473 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/cfd03be55903446aa729bc239598a473 2023-02-13 12:04:03,243 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/fee691fe2fe64b0ebb92d0e755a64a23, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 12:04:03,244 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/b78cf5905f7843c78d924aa4f7630548 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/b78cf5905f7843c78d924aa4f7630548 2023-02-13 12:04:03,246 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/cfd03be55903446aa729bc239598a473, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 12:04:03,246 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d6aaa8cbc07ce7f34bfac7a7da7460ba in 1762ms, sequenceid=5, compaction requested=false 2023-02-13 12:04:03,247 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: 2023-02-13 12:04:03,247 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:03,247 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:04:03,248 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/b78cf5905f7843c78d924aa4f7630548, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 12:04:03,248 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 60a9b9bc2aa1d9558d235def779498de in 1762ms, sequenceid=5, compaction requested=false 2023-02-13 12:04:03,249 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 60a9b9bc2aa1d9558d235def779498de: 2023-02-13 12:04:03,249 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:03,249 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:04:03,249 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:04:03,249 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,249 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 12:04:03,249 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 12:04:03,279 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,279 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:03,279 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:03,279 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:04:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:03,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:03,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 12:04:03,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ac5df47[Count = 0] remaining members to acquire global barrier 2023-02-13 12:04:03,282 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 12:04:03,283 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:03,290 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:03,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:03,290 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 12:04:03,290 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 12:04:03,290 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:04:03,291 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,291 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:04:03,298 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,298 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 12:04:03,299 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:03,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:03,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:03,299 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 12:04:03,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:03,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:03,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:03,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:03,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:03,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:04:03,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 12:04:03,307 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 12:04:03,307 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:04:03,307 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:04:03,307 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 12:04:03,308 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:04:03,321 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:03,321 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:03,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:03,321 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:03,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:03,323 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:03,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:03,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:03,327 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:03,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:03,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,340 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:03,340 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:03,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:03,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 12:04:03,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:04:03,340 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:03,340 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:03,340 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:03,340 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,340 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:03,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 12:04:03,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:03,340 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:03,340 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 12:04:03,341 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:04:03,340 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:03,341 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:03,441 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:04:03,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:04:03,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:03,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:03,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:03,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:04:03,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 12:04:03,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 12:04:03,453 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 12:04:03,453 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:03,454 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 12:04:03,454 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 12:04:03,454 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:03,454 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:03,465 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:03,465 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:03,466 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:03,466 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:04:03,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:03,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:04:03,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:03,468 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 12:04:03,468 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 12:04:03,469 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 12:04:03,469 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 12:04:03,469 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:03,469 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 12:04:03,469 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:03,470 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. started... 2023-02-13 12:04:03,470 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:04:03,470 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:04:03,470 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:03,470 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. started... 2023-02-13 12:04:03,470 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d6aaa8cbc07ce7f34bfac7a7da7460ba 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 12:04:03,470 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 60a9b9bc2aa1d9558d235def779498de 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 12:04:03,470 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:03,471 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. started... 2023-02-13 12:04:03,471 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 21af9b0de93a32d4dff1e415280782a1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 12:04:03,919 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021300b336b795214ed1843495a0919ff57a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021300b336b795214ed1843495a0919ff57a 2023-02-13 12:04:03,930 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213fe9ac5f8f1474e53bb5092f6afc3c8f2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213fe9ac5f8f1474e53bb5092f6afc3c8f2 2023-02-13 12:04:03,930 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302139866fdab0b194bbba2678236cfc653a8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302139866fdab0b194bbba2678236cfc653a8 2023-02-13 12:04:04,332 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/98508f91563b49a884838efa5a7a7870 2023-02-13 12:04:04,344 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/862e69d64b204e7e95c75a9681013541 2023-02-13 12:04:04,349 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/31a76e80ac384a7c8088a203d2eb2894 2023-02-13 12:04:04,791 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:04:04,791 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33aa1422 to 127.0.0.1:62284 2023-02-13 12:04:04,791 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:04:04,791 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:04:04,791 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c3cda66 to 127.0.0.1:62284 2023-02-13 12:04:04,791 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:04:04,793 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302130eb4f7f4af7042d3bef772a4440edfd0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302130eb4f7f4af7042d3bef772a4440edfd0 2023-02-13 12:04:04,793 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302136eabfdc27d874a7f9dbc965bf3442cdb to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302136eabfdc27d874a7f9dbc965bf3442cdb 2023-02-13 12:04:04,794 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021312ce65fa97844b178e3fd56565571e3c to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023021312ce65fa97844b178e3fd56565571e3c 2023-02-13 12:04:05,198 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/58dc169f1b74410faa098f0e605497e0 2023-02-13 12:04:05,202 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/bab035143e6543699d6a4a03b3385084 2023-02-13 12:04:05,202 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/0b4dc409869c4008a0c960fd035fbfe7 2023-02-13 12:04:05,224 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/98508f91563b49a884838efa5a7a7870 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/98508f91563b49a884838efa5a7a7870 2023-02-13 12:04:05,225 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/862e69d64b204e7e95c75a9681013541 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/862e69d64b204e7e95c75a9681013541 2023-02-13 12:04:05,225 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/31a76e80ac384a7c8088a203d2eb2894 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/31a76e80ac384a7c8088a203d2eb2894 2023-02-13 12:04:05,248 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/98508f91563b49a884838efa5a7a7870, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 12:04:05,248 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/862e69d64b204e7e95c75a9681013541, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 12:04:05,249 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/58dc169f1b74410faa098f0e605497e0 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/58dc169f1b74410faa098f0e605497e0 2023-02-13 12:04:05,249 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/bab035143e6543699d6a4a03b3385084 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/bab035143e6543699d6a4a03b3385084 2023-02-13 12:04:05,251 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/31a76e80ac384a7c8088a203d2eb2894, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 12:04:05,252 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/0b4dc409869c4008a0c960fd035fbfe7 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/0b4dc409869c4008a0c960fd035fbfe7 2023-02-13 12:04:05,253 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/bab035143e6543699d6a4a03b3385084, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 12:04:05,253 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/58dc169f1b74410faa098f0e605497e0, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 12:04:05,254 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 21af9b0de93a32d4dff1e415280782a1 in 1783ms, sequenceid=9, compaction requested=false 2023-02-13 12:04:05,254 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 21af9b0de93a32d4dff1e415280782a1: 2023-02-13 12:04:05,254 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:05,254 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d6aaa8cbc07ce7f34bfac7a7da7460ba in 1784ms, sequenceid=9, compaction requested=false 2023-02-13 12:04:05,254 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:04:05,254 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: 2023-02-13 12:04:05,254 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:05,254 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:04:05,256 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/0b4dc409869c4008a0c960fd035fbfe7, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 12:04:05,257 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 60a9b9bc2aa1d9558d235def779498de in 1787ms, sequenceid=9, compaction requested=false 2023-02-13 12:04:05,257 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 60a9b9bc2aa1d9558d235def779498de: 2023-02-13 12:04:05,257 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:05,257 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:04:05,257 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:04:05,257 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,257 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 12:04:05,257 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 12:04:05,270 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,270 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:05,271 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:05,271 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:04:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:05,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 12:04:05,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68228fc7[Count = 0] remaining members to acquire global barrier 2023-02-13 12:04:05,272 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 12:04:05,272 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:05,281 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:05,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:05,282 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 12:04:05,282 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 12:04:05,282 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:04:05,282 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,282 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:04:05,290 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,290 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 12:04:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:05,290 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:05,290 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 12:04:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:04:05,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 12:04:05,292 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 12:04:05,292 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:04:05,292 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:04:05,292 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 12:04:05,292 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:04:05,298 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:05,298 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:05,298 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:05,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:05,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:05,298 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:05,299 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:05,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:05,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,306 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,306 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:05,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 12:04:05,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:04:05,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 12:04:05,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:05,306 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:05,306 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:05,306 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:05,307 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 12:04:05,307 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:04:05,307 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:05,307 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,307 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:05,307 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:05,307 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:05,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:05,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:05,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:05,396 DEBUG [regionserver/jenkins-hbase16:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 12:04:05,407 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:04:05,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:04:05,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:05,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:05,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:05,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:04:05,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 12:04:05,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 12:04:05,414 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 12:04:05,414 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:05,414 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 12:04:05,414 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 12:04:05,415 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:05,415 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:05,423 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:05,423 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:05,424 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:05,424 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:04:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:05,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:05,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:04:05,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:05,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 12:04:05,426 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 12:04:05,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 12:04:05,426 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 12:04:05,426 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:05,426 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 12:04:05,427 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:05,427 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. started... 2023-02-13 12:04:05,427 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:04:05,427 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:04:05,427 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:05,427 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d6aaa8cbc07ce7f34bfac7a7da7460ba 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 12:04:05,427 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:05,427 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. started... 2023-02-13 12:04:05,427 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. started... 2023-02-13 12:04:05,428 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 60a9b9bc2aa1d9558d235def779498de 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 12:04:05,428 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 21af9b0de93a32d4dff1e415280782a1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 12:04:05,480 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213af2dc009393843b09224be0fada52b6d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213af2dc009393843b09224be0fada52b6d 2023-02-13 12:04:05,481 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213821c869acab1429b858c99813b554920 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213821c869acab1429b858c99813b554920 2023-02-13 12:04:05,487 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302137e0f16c36da9483a9f2f3fceb6b31c2b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302137e0f16c36da9483a9f2f3fceb6b31c2b 2023-02-13 12:04:05,492 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/b1fcd0185de743bfa6ebdc51a9b95484 2023-02-13 12:04:05,902 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/82470fc2bf4b41488991786e5994d6b8 2023-02-13 12:04:05,904 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/09f5d972d0ed4a408e47da4eaa3d282f 2023-02-13 12:04:05,922 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021385238af03d66455f93209c3e3493dc8e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021385238af03d66455f93209c3e3493dc8e 2023-02-13 12:04:05,927 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/ba8af434aaa4426f85509ba713a1c374 2023-02-13 12:04:05,930 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/b1fcd0185de743bfa6ebdc51a9b95484 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/b1fcd0185de743bfa6ebdc51a9b95484 2023-02-13 12:04:05,955 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/b1fcd0185de743bfa6ebdc51a9b95484, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 12:04:05,956 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/ba8af434aaa4426f85509ba713a1c374 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/ba8af434aaa4426f85509ba713a1c374 2023-02-13 12:04:05,959 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/ba8af434aaa4426f85509ba713a1c374, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 12:04:05,959 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d6aaa8cbc07ce7f34bfac7a7da7460ba in 532ms, sequenceid=13, compaction requested=true 2023-02-13 12:04:05,959 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: 2023-02-13 12:04:05,959 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:05,959 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:04:06,054 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 12:04:06,357 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213f1f7b2abb6df463680b15adf696c6609 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213f1f7b2abb6df463680b15adf696c6609 2023-02-13 12:04:06,357 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021304a442f4ce8e4e2db67f72c2464e2af2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021304a442f4ce8e4e2db67f72c2464e2af2 2023-02-13 12:04:06,763 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/f0bbd58a3341416d9d9b097ea14905e9 2023-02-13 12:04:06,763 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/28b3b9a73e624d8baaf7d5af3737f286 2023-02-13 12:04:06,769 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/09f5d972d0ed4a408e47da4eaa3d282f as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/09f5d972d0ed4a408e47da4eaa3d282f 2023-02-13 12:04:06,769 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/82470fc2bf4b41488991786e5994d6b8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/82470fc2bf4b41488991786e5994d6b8 2023-02-13 12:04:06,792 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/09f5d972d0ed4a408e47da4eaa3d282f, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 12:04:06,792 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/82470fc2bf4b41488991786e5994d6b8, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 12:04:06,793 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/f0bbd58a3341416d9d9b097ea14905e9 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/f0bbd58a3341416d9d9b097ea14905e9 2023-02-13 12:04:06,793 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/28b3b9a73e624d8baaf7d5af3737f286 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/28b3b9a73e624d8baaf7d5af3737f286 2023-02-13 12:04:06,797 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/f0bbd58a3341416d9d9b097ea14905e9, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 12:04:06,797 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/28b3b9a73e624d8baaf7d5af3737f286, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 12:04:06,798 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 60a9b9bc2aa1d9558d235def779498de in 1370ms, sequenceid=13, compaction requested=true 2023-02-13 12:04:06,798 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 21af9b0de93a32d4dff1e415280782a1 in 1370ms, sequenceid=13, compaction requested=true 2023-02-13 12:04:06,798 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 60a9b9bc2aa1d9558d235def779498de: 2023-02-13 12:04:06,798 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 21af9b0de93a32d4dff1e415280782a1: 2023-02-13 12:04:06,798 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:06,798 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:06,798 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:04:06,798 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:04:06,798 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:04:06,798 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,798 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 12:04:06,798 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 12:04:06,829 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,829 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:06,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:06,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:06,829 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:06,830 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:04:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:06,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:06,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 12:04:06,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@226965f5[Count = 0] remaining members to acquire global barrier 2023-02-13 12:04:06,833 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 12:04:06,833 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:06,840 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:06,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:06,840 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 12:04:06,840 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 12:04:06,840 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:04:06,840 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,841 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:04:06,848 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 12:04:06,848 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,848 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:06,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:06,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:06,849 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 12:04:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:06,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:06,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:06,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:04:06,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 12:04:06,856 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 12:04:06,856 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:04:06,857 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:04:06,857 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 12:04:06,857 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:04:06,865 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:06,865 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:06,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:06,865 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:06,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:06,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:06,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:06,866 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:06,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:06,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:06,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:06,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,869 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:06,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,906 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:06,906 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:06,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:06,906 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:06,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 12:04:06,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:04:06,906 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:06,906 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:06,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:06,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:06,907 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:06,907 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 12:04:06,907 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:06,908 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:04:06,908 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:06,908 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:06,908 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:07,008 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:04:07,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:04:07,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:07,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:07,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 12:04:07,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:04:07,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 12:04:07,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 12:04:07,024 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 12:04:07,024 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:07,024 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 12:04:07,024 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 12:04:07,025 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:07,025 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:07,040 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:07,040 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:07,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:07,041 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:07,041 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:04:07,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:04:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:07,042 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 12:04:07,043 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 12:04:07,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 12:04:07,043 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 12:04:07,043 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:07,043 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 12:04:07,044 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:07,044 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. started... 2023-02-13 12:04:07,044 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:04:07,044 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:04:07,044 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d6aaa8cbc07ce7f34bfac7a7da7460ba 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 12:04:07,044 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:07,044 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:07,044 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. started... 2023-02-13 12:04:07,044 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. started... 2023-02-13 12:04:07,044 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 21af9b0de93a32d4dff1e415280782a1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 12:04:07,045 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 60a9b9bc2aa1d9558d235def779498de 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 12:04:07,087 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021311da57148552434ebe3806d788e81249 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021311da57148552434ebe3806d788e81249 2023-02-13 12:04:07,495 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302136465116b04b4435b88628fbece946bb6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302136465116b04b4435b88628fbece946bb6 2023-02-13 12:04:07,499 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/342ca3782f6e4a149eb7a539ff097358 2023-02-13 12:04:07,505 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213f41991dd633b44229c1032596f8720a4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213f41991dd633b44229c1032596f8720a4 2023-02-13 12:04:07,910 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/1be56bdeee8d46e88b55b52fd40061fa 2023-02-13 12:04:07,918 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/e9392b8daeb748d7acd0e5808f515ea0 2023-02-13 12:04:07,929 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302139990352bb424448587c94499bf2f1bf4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302139990352bb424448587c94499bf2f1bf4 2023-02-13 12:04:08,335 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/5f6f54dbddd04b8b89c9ac70c3b55763 2023-02-13 12:04:08,345 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/342ca3782f6e4a149eb7a539ff097358 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/342ca3782f6e4a149eb7a539ff097358 2023-02-13 12:04:08,350 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213d2b94de48f6349ad9ace0de52d1ea731 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213d2b94de48f6349ad9ace0de52d1ea731 2023-02-13 12:04:08,350 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021342db20e4367a4b3d8825b57099fda790 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021342db20e4367a4b3d8825b57099fda790 2023-02-13 12:04:08,357 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/8ed614f13321459cb818c987c7a8183a 2023-02-13 12:04:08,360 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/e9392b8daeb748d7acd0e5808f515ea0 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/e9392b8daeb748d7acd0e5808f515ea0 2023-02-13 12:04:08,378 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/342ca3782f6e4a149eb7a539ff097358, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 12:04:08,378 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/e9392b8daeb748d7acd0e5808f515ea0, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 12:04:08,379 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/5f6f54dbddd04b8b89c9ac70c3b55763 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/5f6f54dbddd04b8b89c9ac70c3b55763 2023-02-13 12:04:08,379 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/8ed614f13321459cb818c987c7a8183a as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/8ed614f13321459cb818c987c7a8183a 2023-02-13 12:04:08,382 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/5f6f54dbddd04b8b89c9ac70c3b55763, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 12:04:08,382 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/8ed614f13321459cb818c987c7a8183a, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 12:04:08,383 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 60a9b9bc2aa1d9558d235def779498de in 1339ms, sequenceid=17, compaction requested=true 2023-02-13 12:04:08,383 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d6aaa8cbc07ce7f34bfac7a7da7460ba in 1339ms, sequenceid=17, compaction requested=true 2023-02-13 12:04:08,383 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 60a9b9bc2aa1d9558d235def779498de: 2023-02-13 12:04:08,383 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: 2023-02-13 12:04:08,383 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:08,383 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:08,383 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:04:08,383 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:04:08,755 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/2c3d54c612ee4d56a33def7001c878ce 2023-02-13 12:04:08,767 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/1be56bdeee8d46e88b55b52fd40061fa as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1be56bdeee8d46e88b55b52fd40061fa 2023-02-13 12:04:08,788 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1be56bdeee8d46e88b55b52fd40061fa, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 12:04:08,789 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/2c3d54c612ee4d56a33def7001c878ce as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/2c3d54c612ee4d56a33def7001c878ce 2023-02-13 12:04:08,793 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/2c3d54c612ee4d56a33def7001c878ce, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 12:04:08,794 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 21af9b0de93a32d4dff1e415280782a1 in 1750ms, sequenceid=17, compaction requested=true 2023-02-13 12:04:08,794 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 21af9b0de93a32d4dff1e415280782a1: 2023-02-13 12:04:08,794 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:08,794 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:04:08,794 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:04:08,794 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,794 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 12:04:08,794 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 12:04:08,829 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,829 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:08,829 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:08,829 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:04:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:08,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:08,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:08,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 12:04:08,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33f65092[Count = 0] remaining members to acquire global barrier 2023-02-13 12:04:08,832 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 12:04:08,832 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:08,839 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:08,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:08,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:08,840 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 12:04:08,840 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 12:04:08,840 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:04:08,840 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,840 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:04:08,848 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,848 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 12:04:08,848 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:08,848 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 12:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:04:08,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 12:04:08,855 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 12:04:08,855 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:04:08,855 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:04:08,855 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 12:04:08,855 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:04:08,865 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:08,865 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:08,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:08,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:08,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:08,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:08,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:08,865 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:08,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:08,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:08,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:08,866 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,870 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:08,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,881 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,881 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:08,881 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:08,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 12:04:08,881 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:08,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:08,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 12:04:08,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:04:08,881 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:08,881 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:08,882 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:08,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:08,882 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:08,882 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 12:04:08,882 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:08,882 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:04:08,882 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:08,982 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:04:08,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:04:08,991 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:04:08,999 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:04:09,008 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:04:09,009 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:04:09,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(933): Client=jenkins//188.40.62.62 procedure request for: flush-table-proc 2023-02-13 12:04:09,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 12:04:09,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 12:04:09,099 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 12:04:09,099 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:09,099 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 12:04:09,099 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 12:04:09,100 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:09,100 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:09,106 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:09,106 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:09,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:09,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:09,107 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:09,107 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 12:04:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:09,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 12:04:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:09,107 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 12:04:09,108 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 12:04:09,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 12:04:09,108 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 12:04:09,108 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 12:04:09,108 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 12:04:09,108 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:09,108 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. started... 2023-02-13 12:04:09,108 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:09,108 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 12:04:09,108 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 12:04:09,108 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. started... 2023-02-13 12:04:09,108 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:09,108 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d6aaa8cbc07ce7f34bfac7a7da7460ba 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 12:04:09,108 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 60a9b9bc2aa1d9558d235def779498de 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 12:04:09,108 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. started... 2023-02-13 12:04:09,108 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 21af9b0de93a32d4dff1e415280782a1 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 12:04:09,549 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/a13e7ac43c5b427b9951d05aa3093493 2023-02-13 12:04:09,549 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/14f31787773a4c338303f9a11f9658a6 2023-02-13 12:04:09,551 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/ed47d39030f24fad982f68d3784baf70 2023-02-13 12:04:09,569 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14f31787773a4c338303f9a11f9658a6 2023-02-13 12:04:09,576 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a13e7ac43c5b427b9951d05aa3093493 2023-02-13 12:04:09,579 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed47d39030f24fad982f68d3784baf70 2023-02-13 12:04:09,991 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/652ee53cb5fc4a8d95f3da873e1a27c2 2023-02-13 12:04:09,992 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/7efde2277f2e4d43920d6ff9daff23c7 2023-02-13 12:04:09,994 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7efde2277f2e4d43920d6ff9daff23c7 2023-02-13 12:04:09,994 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 652ee53cb5fc4a8d95f3da873e1a27c2 2023-02-13 12:04:09,995 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/ed47d39030f24fad982f68d3784baf70 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/ed47d39030f24fad982f68d3784baf70 2023-02-13 12:04:09,995 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/a13e7ac43c5b427b9951d05aa3093493 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/a13e7ac43c5b427b9951d05aa3093493 2023-02-13 12:04:10,014 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a13e7ac43c5b427b9951d05aa3093493 2023-02-13 12:04:10,015 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/a13e7ac43c5b427b9951d05aa3093493, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 12:04:10,015 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed47d39030f24fad982f68d3784baf70 2023-02-13 12:04:10,015 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/ed47d39030f24fad982f68d3784baf70, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 12:04:10,015 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/652ee53cb5fc4a8d95f3da873e1a27c2 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/652ee53cb5fc4a8d95f3da873e1a27c2 2023-02-13 12:04:10,015 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/7efde2277f2e4d43920d6ff9daff23c7 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/7efde2277f2e4d43920d6ff9daff23c7 2023-02-13 12:04:10,018 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 652ee53cb5fc4a8d95f3da873e1a27c2 2023-02-13 12:04:10,018 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/652ee53cb5fc4a8d95f3da873e1a27c2, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 12:04:10,018 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7efde2277f2e4d43920d6ff9daff23c7 2023-02-13 12:04:10,018 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/7efde2277f2e4d43920d6ff9daff23c7, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 12:04:10,019 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 21af9b0de93a32d4dff1e415280782a1 in 911ms, sequenceid=23, compaction requested=true 2023-02-13 12:04:10,019 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 60a9b9bc2aa1d9558d235def779498de in 911ms, sequenceid=23, compaction requested=true 2023-02-13 12:04:10,019 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 21af9b0de93a32d4dff1e415280782a1: 2023-02-13 12:04:10,019 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 60a9b9bc2aa1d9558d235def779498de: 2023-02-13 12:04:10,019 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:10,019 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:10,019 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 12:04:10,019 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 12:04:10,386 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/a1650faa6f354f26bae2ee14ee3a0056 2023-02-13 12:04:10,391 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1650faa6f354f26bae2ee14ee3a0056 2023-02-13 12:04:10,392 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/14f31787773a4c338303f9a11f9658a6 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/14f31787773a4c338303f9a11f9658a6 2023-02-13 12:04:10,413 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14f31787773a4c338303f9a11f9658a6 2023-02-13 12:04:10,413 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/14f31787773a4c338303f9a11f9658a6, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 12:04:10,414 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/a1650faa6f354f26bae2ee14ee3a0056 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/a1650faa6f354f26bae2ee14ee3a0056 2023-02-13 12:04:10,417 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1650faa6f354f26bae2ee14ee3a0056 2023-02-13 12:04:10,417 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/a1650faa6f354f26bae2ee14ee3a0056, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 12:04:10,418 INFO [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d6aaa8cbc07ce7f34bfac7a7da7460ba in 1310ms, sequenceid=23, compaction requested=true 2023-02-13 12:04:10,418 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: 2023-02-13 12:04:10,418 DEBUG [rs(jenkins-hbase16.apache.org,39857,1676289663697)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:10,418 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 12:04:10,418 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 12:04:10,418 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,418 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 12:04:10,418 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 12:04:10,462 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,462 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:10,463 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:10,463 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 12:04:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:10,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,39857,1676289663697' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 12:04:10,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@572d9e4c[Count = 0] remaining members to acquire global barrier 2023-02-13 12:04:10,467 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 12:04:10,467 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:10,473 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:10,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:10,473 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 12:04:10,474 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 12:04:10,474 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase16.apache.org,39857,1676289663697' in zk 2023-02-13 12:04:10,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,474 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 12:04:10,481 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 12:04:10,481 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:10,482 DEBUG [member: 'jenkins-hbase16.apache.org,39857,1676289663697' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 12:04:10,481 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:10,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase16.apache.org,39857,1676289663697': 2023-02-13 12:04:10,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,39857,1676289663697' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 12:04:10,491 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 12:04:10,491 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 12:04:10,491 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 12:04:10,492 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 12:04:10,492 INFO [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 12:04:10,504 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:10,504 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:10,504 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:10,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:10,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 12:04:10,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 12:04:10,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:10,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:10,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 12:04:10,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:10,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:10,506 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:10,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 12:04:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,510 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 12:04:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 12:04:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:10,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 12:04:10,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 12:04:10,523 DEBUG [(jenkins-hbase16.apache.org,44533,1676289662559)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 12:04:10,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 12:04:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 12:04:10,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 12:04:10,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 12:04:10,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 12:04:10,523 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:10,524 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:10,524 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 12:04:10,524 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 12:04:10,524 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 12:04:10,524 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 12:04:10,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 12:04:10,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 12:04:10,624 DEBUG [Listener at localhost.localdomain/40603] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 12:04:10,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 12:04:10,627 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:04:10,627 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): d6aaa8cbc07ce7f34bfac7a7da7460ba/family1 is initiating major compaction (all files) 2023-02-13 12:04:10,627 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:04:10,628 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:04:10,628 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of d6aaa8cbc07ce7f34bfac7a7da7460ba/family1 in testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:10,628 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/ab758d73c164462caa9cd42d7b8d1d5a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/98508f91563b49a884838efa5a7a7870, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/b1fcd0185de743bfa6ebdc51a9b95484, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/e9392b8daeb748d7acd0e5808f515ea0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/14f31787773a4c338303f9a11f9658a6] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp, totalSize=27.1 K 2023-02-13 12:04:10,629 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting ab758d73c164462caa9cd42d7b8d1d5a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289841438 2023-02-13 12:04:10,631 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 98508f91563b49a884838efa5a7a7870, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289843446 2023-02-13 12:04:10,632 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting b1fcd0185de743bfa6ebdc51a9b95484, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289845409 2023-02-13 12:04:10,633 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting e9392b8daeb748d7acd0e5808f515ea0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289847014 2023-02-13 12:04:10,634 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 14f31787773a4c338303f9a11f9658a6, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:04:10,643 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): d6aaa8cbc07ce7f34bfac7a7da7460ba#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:04:11,086 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213fb9333b6f49743da9cb819c4d95a4745_del 2023-02-13 12:04:11,086 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213fb9333b6f49743da9cb819c4d95a4745_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213fb9333b6f49743da9cb819c4d95a4745_del 2023-02-13 12:04:11,961 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1ace46e2b5d43418dfbfbfcb12cddb0 2023-02-13 12:04:11,962 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family1/b1ace46e2b5d43418dfbfbfcb12cddb0 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/b1ace46e2b5d43418dfbfbfcb12cddb0 2023-02-13 12:04:11,981 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1ace46e2b5d43418dfbfbfcb12cddb0 2023-02-13 12:04:11,982 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d6aaa8cbc07ce7f34bfac7a7da7460ba/family1 of d6aaa8cbc07ce7f34bfac7a7da7460ba into b1ace46e2b5d43418dfbfbfcb12cddb0(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:04:11,982 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: 2023-02-13 12:04:11,982 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:04:11,982 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): d6aaa8cbc07ce7f34bfac7a7da7460ba/family2 is initiating major compaction (all files) 2023-02-13 12:04:11,983 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:04:11,983 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:04:11,983 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of d6aaa8cbc07ce7f34bfac7a7da7460ba/family2 in testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:11,983 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/cfd03be55903446aa729bc239598a473, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/58dc169f1b74410faa098f0e605497e0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/ba8af434aaa4426f85509ba713a1c374, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/8ed614f13321459cb818c987c7a8183a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/a1650faa6f354f26bae2ee14ee3a0056] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp, totalSize=25.4 K 2023-02-13 12:04:11,983 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting cfd03be55903446aa729bc239598a473, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289841438 2023-02-13 12:04:11,984 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 58dc169f1b74410faa098f0e605497e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289843446 2023-02-13 12:04:11,984 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting ba8af434aaa4426f85509ba713a1c374, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289845409 2023-02-13 12:04:11,984 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 8ed614f13321459cb818c987c7a8183a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289847014 2023-02-13 12:04:11,985 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting a1650faa6f354f26bae2ee14ee3a0056, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:04:11,991 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): d6aaa8cbc07ce7f34bfac7a7da7460ba#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:04:12,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/ab758d73c164462caa9cd42d7b8d1d5a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/98508f91563b49a884838efa5a7a7870, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/b1fcd0185de743bfa6ebdc51a9b95484, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/e9392b8daeb748d7acd0e5808f515ea0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/14f31787773a4c338303f9a11f9658a6] to archive 2023-02-13 12:04:12,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:12,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/ab758d73c164462caa9cd42d7b8d1d5a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/ab758d73c164462caa9cd42d7b8d1d5a 2023-02-13 12:04:12,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/98508f91563b49a884838efa5a7a7870 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/98508f91563b49a884838efa5a7a7870 2023-02-13 12:04:12,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/b1fcd0185de743bfa6ebdc51a9b95484 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/b1fcd0185de743bfa6ebdc51a9b95484 2023-02-13 12:04:12,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/e9392b8daeb748d7acd0e5808f515ea0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/e9392b8daeb748d7acd0e5808f515ea0 2023-02-13 12:04:12,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/14f31787773a4c338303f9a11f9658a6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/14f31787773a4c338303f9a11f9658a6 2023-02-13 12:04:12,407 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021368a829dc25524a0c88b517f1719bff26_del 2023-02-13 12:04:12,407 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021368a829dc25524a0c88b517f1719bff26_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021368a829dc25524a0c88b517f1719bff26_del 2023-02-13 12:04:13,236 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0d5697ab20e4ba096098e9ff7439234 2023-02-13 12:04:13,237 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/.tmp/family2/b0d5697ab20e4ba096098e9ff7439234 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/b0d5697ab20e4ba096098e9ff7439234 2023-02-13 12:04:13,243 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0d5697ab20e4ba096098e9ff7439234 2023-02-13 12:04:13,244 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d6aaa8cbc07ce7f34bfac7a7da7460ba/family2 of d6aaa8cbc07ce7f34bfac7a7da7460ba into b0d5697ab20e4ba096098e9ff7439234(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:04:13,244 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: 2023-02-13 12:04:13,244 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:04:13,244 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 60a9b9bc2aa1d9558d235def779498de/family1 is initiating major compaction (all files) 2023-02-13 12:04:13,245 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:04:13,245 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:04:13,245 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 60a9b9bc2aa1d9558d235def779498de/family1 in testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:13,245 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/fee691fe2fe64b0ebb92d0e755a64a23, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/31a76e80ac384a7c8088a203d2eb2894, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/09f5d972d0ed4a408e47da4eaa3d282f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/342ca3782f6e4a149eb7a539ff097358, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/a13e7ac43c5b427b9951d05aa3093493] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp, totalSize=27.1 K 2023-02-13 12:04:13,246 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting fee691fe2fe64b0ebb92d0e755a64a23, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289841437 2023-02-13 12:04:13,246 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 31a76e80ac384a7c8088a203d2eb2894, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289843445 2023-02-13 12:04:13,247 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 09f5d972d0ed4a408e47da4eaa3d282f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289845409 2023-02-13 12:04:13,247 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 342ca3782f6e4a149eb7a539ff097358, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289847013 2023-02-13 12:04:13,247 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting a13e7ac43c5b427b9951d05aa3093493, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:04:13,258 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 60a9b9bc2aa1d9558d235def779498de#family1#compaction#200 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:04:13,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/cfd03be55903446aa729bc239598a473, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/58dc169f1b74410faa098f0e605497e0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/ba8af434aaa4426f85509ba713a1c374, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/8ed614f13321459cb818c987c7a8183a, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/a1650faa6f354f26bae2ee14ee3a0056] to archive 2023-02-13 12:04:13,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:13,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/cfd03be55903446aa729bc239598a473 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/cfd03be55903446aa729bc239598a473 2023-02-13 12:04:13,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/58dc169f1b74410faa098f0e605497e0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/58dc169f1b74410faa098f0e605497e0 2023-02-13 12:04:13,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/ba8af434aaa4426f85509ba713a1c374 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/ba8af434aaa4426f85509ba713a1c374 2023-02-13 12:04:13,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/8ed614f13321459cb818c987c7a8183a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/8ed614f13321459cb818c987c7a8183a 2023-02-13 12:04:13,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/a1650faa6f354f26bae2ee14ee3a0056 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family2/a1650faa6f354f26bae2ee14ee3a0056 2023-02-13 12:04:13,292 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302136084f1455f4d452a8969678d0f2445c8_del 2023-02-13 12:04:13,292 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302136084f1455f4d452a8969678d0f2445c8_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302136084f1455f4d452a8969678d0f2445c8_del 2023-02-13 12:04:13,750 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9fbdbd2682a4b95aee3d9478c9f9b54 2023-02-13 12:04:13,751 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family1/f9fbdbd2682a4b95aee3d9478c9f9b54 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/f9fbdbd2682a4b95aee3d9478c9f9b54 2023-02-13 12:04:13,767 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9fbdbd2682a4b95aee3d9478c9f9b54 2023-02-13 12:04:13,768 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 60a9b9bc2aa1d9558d235def779498de/family1 of 60a9b9bc2aa1d9558d235def779498de into f9fbdbd2682a4b95aee3d9478c9f9b54(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:04:13,768 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 60a9b9bc2aa1d9558d235def779498de: 2023-02-13 12:04:13,768 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:04:13,768 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 60a9b9bc2aa1d9558d235def779498de/family2 is initiating major compaction (all files) 2023-02-13 12:04:13,768 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:04:13,769 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:04:13,769 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 60a9b9bc2aa1d9558d235def779498de/family2 in testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:13,769 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/b78cf5905f7843c78d924aa4f7630548, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/0b4dc409869c4008a0c960fd035fbfe7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/f0bbd58a3341416d9d9b097ea14905e9, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/5f6f54dbddd04b8b89c9ac70c3b55763, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/652ee53cb5fc4a8d95f3da873e1a27c2] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp, totalSize=25.4 K 2023-02-13 12:04:13,769 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting b78cf5905f7843c78d924aa4f7630548, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289841437 2023-02-13 12:04:13,769 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 0b4dc409869c4008a0c960fd035fbfe7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289843445 2023-02-13 12:04:13,770 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting f0bbd58a3341416d9d9b097ea14905e9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289845409 2023-02-13 12:04:13,770 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 5f6f54dbddd04b8b89c9ac70c3b55763, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289847013 2023-02-13 12:04:13,770 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 652ee53cb5fc4a8d95f3da873e1a27c2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:04:13,777 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 60a9b9bc2aa1d9558d235def779498de#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:04:13,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/fee691fe2fe64b0ebb92d0e755a64a23, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/31a76e80ac384a7c8088a203d2eb2894, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/09f5d972d0ed4a408e47da4eaa3d282f, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/342ca3782f6e4a149eb7a539ff097358, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/a13e7ac43c5b427b9951d05aa3093493] to archive 2023-02-13 12:04:13,876 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:13,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/fee691fe2fe64b0ebb92d0e755a64a23 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/fee691fe2fe64b0ebb92d0e755a64a23 2023-02-13 12:04:13,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/31a76e80ac384a7c8088a203d2eb2894 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/31a76e80ac384a7c8088a203d2eb2894 2023-02-13 12:04:13,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/09f5d972d0ed4a408e47da4eaa3d282f to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/09f5d972d0ed4a408e47da4eaa3d282f 2023-02-13 12:04:13,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/342ca3782f6e4a149eb7a539ff097358 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/342ca3782f6e4a149eb7a539ff097358 2023-02-13 12:04:13,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/a13e7ac43c5b427b9951d05aa3093493 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/a13e7ac43c5b427b9951d05aa3093493 2023-02-13 12:04:14,192 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213beb81458623946dd9cb019d35e306c7f_del 2023-02-13 12:04:14,193 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213beb81458623946dd9cb019d35e306c7f_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213beb81458623946dd9cb019d35e306c7f_del 2023-02-13 12:04:14,618 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2671abdbda134846918690b83cabae5f 2023-02-13 12:04:14,619 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/.tmp/family2/2671abdbda134846918690b83cabae5f as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/2671abdbda134846918690b83cabae5f 2023-02-13 12:04:14,624 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2671abdbda134846918690b83cabae5f 2023-02-13 12:04:14,625 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 60a9b9bc2aa1d9558d235def779498de/family2 of 60a9b9bc2aa1d9558d235def779498de into 2671abdbda134846918690b83cabae5f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 12:04:14,625 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 60a9b9bc2aa1d9558d235def779498de: 2023-02-13 12:04:14,626 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:04:14,626 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 21af9b0de93a32d4dff1e415280782a1/family1 is initiating major compaction (all files) 2023-02-13 12:04:14,626 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:04:14,626 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:04:14,626 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 21af9b0de93a32d4dff1e415280782a1/family1 in testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:14,626 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/93bc74830a414152a722a1a814384101, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/862e69d64b204e7e95c75a9681013541, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/82470fc2bf4b41488991786e5994d6b8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1be56bdeee8d46e88b55b52fd40061fa, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/ed47d39030f24fad982f68d3784baf70] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp, totalSize=27.1 K 2023-02-13 12:04:14,627 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 93bc74830a414152a722a1a814384101, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289841438 2023-02-13 12:04:14,627 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 862e69d64b204e7e95c75a9681013541, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289843446 2023-02-13 12:04:14,628 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 82470fc2bf4b41488991786e5994d6b8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289845409 2023-02-13 12:04:14,629 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 1be56bdeee8d46e88b55b52fd40061fa, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289847013 2023-02-13 12:04:14,629 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting ed47d39030f24fad982f68d3784baf70, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:04:14,640 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 21af9b0de93a32d4dff1e415280782a1#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:04:14,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/b78cf5905f7843c78d924aa4f7630548, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/0b4dc409869c4008a0c960fd035fbfe7, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/f0bbd58a3341416d9d9b097ea14905e9, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/5f6f54dbddd04b8b89c9ac70c3b55763, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/652ee53cb5fc4a8d95f3da873e1a27c2] to archive 2023-02-13 12:04:14,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:14,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/b78cf5905f7843c78d924aa4f7630548 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/b78cf5905f7843c78d924aa4f7630548 2023-02-13 12:04:14,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/0b4dc409869c4008a0c960fd035fbfe7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/0b4dc409869c4008a0c960fd035fbfe7 2023-02-13 12:04:14,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/f0bbd58a3341416d9d9b097ea14905e9 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/f0bbd58a3341416d9d9b097ea14905e9 2023-02-13 12:04:14,674 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/5f6f54dbddd04b8b89c9ac70c3b55763 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/5f6f54dbddd04b8b89c9ac70c3b55763 2023-02-13 12:04:14,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/652ee53cb5fc4a8d95f3da873e1a27c2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family2/652ee53cb5fc4a8d95f3da873e1a27c2 2023-02-13 12:04:15,087 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302137d368ddc700b457a897a622004b03fc4_del 2023-02-13 12:04:15,088 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302137d368ddc700b457a897a622004b03fc4_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302137d368ddc700b457a897a622004b03fc4_del 2023-02-13 12:04:15,948 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77f6c70901ea40c69d86b888a76a7ca9 2023-02-13 12:04:15,949 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family1/77f6c70901ea40c69d86b888a76a7ca9 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/77f6c70901ea40c69d86b888a76a7ca9 2023-02-13 12:04:15,967 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77f6c70901ea40c69d86b888a76a7ca9 2023-02-13 12:04:15,968 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 21af9b0de93a32d4dff1e415280782a1/family1 of 21af9b0de93a32d4dff1e415280782a1 into 77f6c70901ea40c69d86b888a76a7ca9(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:04:15,968 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 21af9b0de93a32d4dff1e415280782a1: 2023-02-13 12:04:15,968 DEBUG [Listener at localhost.localdomain/40603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 12:04:15,968 DEBUG [Listener at localhost.localdomain/40603] regionserver.HStore(1912): 21af9b0de93a32d4dff1e415280782a1/family2 is initiating major compaction (all files) 2023-02-13 12:04:15,968 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 12:04:15,968 INFO [Listener at localhost.localdomain/40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 12:04:15,970 INFO [Listener at localhost.localdomain/40603] regionserver.HRegion(2258): Starting compaction of 21af9b0de93a32d4dff1e415280782a1/family2 in testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:15,970 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/3a95140dd3924f848f570532fec6b4d0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/bab035143e6543699d6a4a03b3385084, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/28b3b9a73e624d8baaf7d5af3737f286, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/2c3d54c612ee4d56a33def7001c878ce, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/7efde2277f2e4d43920d6ff9daff23c7] into tmpdir=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp, totalSize=25.4 K 2023-02-13 12:04:15,970 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 3a95140dd3924f848f570532fec6b4d0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676289841438 2023-02-13 12:04:15,970 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting bab035143e6543699d6a4a03b3385084, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676289843446 2023-02-13 12:04:15,971 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 28b3b9a73e624d8baaf7d5af3737f286, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676289845409 2023-02-13 12:04:15,971 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 2c3d54c612ee4d56a33def7001c878ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676289847013 2023-02-13 12:04:15,971 DEBUG [Listener at localhost.localdomain/40603] compactions.Compactor(207): Compacting 7efde2277f2e4d43920d6ff9daff23c7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 12:04:15,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/93bc74830a414152a722a1a814384101, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/862e69d64b204e7e95c75a9681013541, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/82470fc2bf4b41488991786e5994d6b8, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1be56bdeee8d46e88b55b52fd40061fa, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/ed47d39030f24fad982f68d3784baf70] to archive 2023-02-13 12:04:15,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:15,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/93bc74830a414152a722a1a814384101 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/93bc74830a414152a722a1a814384101 2023-02-13 12:04:15,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/862e69d64b204e7e95c75a9681013541 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/862e69d64b204e7e95c75a9681013541 2023-02-13 12:04:15,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/82470fc2bf4b41488991786e5994d6b8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/82470fc2bf4b41488991786e5994d6b8 2023-02-13 12:04:15,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1be56bdeee8d46e88b55b52fd40061fa to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1be56bdeee8d46e88b55b52fd40061fa 2023-02-13 12:04:15,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/ed47d39030f24fad982f68d3784baf70 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/ed47d39030f24fad982f68d3784baf70 2023-02-13 12:04:15,979 INFO [Listener at localhost.localdomain/40603] throttle.PressureAwareThroughputController(145): 21af9b0de93a32d4dff1e415280782a1#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 12:04:16,393 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213f7a28ffc2be145cd8d7d21d301a7c291_del 2023-02-13 12:04:16,394 INFO [Listener at localhost.localdomain/40603] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213f7a28ffc2be145cd8d7d21d301a7c291_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213f7a28ffc2be145cd8d7d21d301a7c291_del 2023-02-13 12:04:17,222 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63f6a959a81d4104aa2fa7a6203d9628 2023-02-13 12:04:17,223 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/.tmp/family2/63f6a959a81d4104aa2fa7a6203d9628 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/63f6a959a81d4104aa2fa7a6203d9628 2023-02-13 12:04:17,229 INFO [Listener at localhost.localdomain/40603] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63f6a959a81d4104aa2fa7a6203d9628 2023-02-13 12:04:17,230 INFO [Listener at localhost.localdomain/40603] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 21af9b0de93a32d4dff1e415280782a1/family2 of 21af9b0de93a32d4dff1e415280782a1 into 63f6a959a81d4104aa2fa7a6203d9628(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 12:04:17,230 DEBUG [Listener at localhost.localdomain/40603] regionserver.HRegion(2288): Compaction status journal for 21af9b0de93a32d4dff1e415280782a1: 2023-02-13 12:04:17,235 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:04:17,239 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:04:17,243 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:04:17,244 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:04:17,249 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44533] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC0Y:\xE8\x98\x09=\xCA{\xA2\xAD\xB0\x1C\xDA\xD2\x8F"\x10\xE9\x05\x0A\xB8\xF5\x12\xF5|\xDE:9\xEBy\x87Fb*\x10\x02\x0F\xD7\xF3,\x7F$\x05\xE5f\x03\x92w\xA9Yp2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-13 12:04:17,267 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 12:04:17,268 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 12:04:17,268 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676290457268 2023-02-13 12:04:17,268 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:04:17,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/3a95140dd3924f848f570532fec6b4d0, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/bab035143e6543699d6a4a03b3385084, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/28b3b9a73e624d8baaf7d5af3737f286, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/2c3d54c612ee4d56a33def7001c878ce, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/7efde2277f2e4d43920d6ff9daff23c7] to archive 2023-02-13 12:04:17,269 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 12:04:17,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:17,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/3a95140dd3924f848f570532fec6b4d0 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/3a95140dd3924f848f570532fec6b4d0 2023-02-13 12:04:17,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/bab035143e6543699d6a4a03b3385084 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/bab035143e6543699d6a4a03b3385084 2023-02-13 12:04:17,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/28b3b9a73e624d8baaf7d5af3737f286 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/28b3b9a73e624d8baaf7d5af3737f286 2023-02-13 12:04:17,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/2c3d54c612ee4d56a33def7001c878ce to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/2c3d54c612ee4d56a33def7001c878ce 2023-02-13 12:04:17,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/7efde2277f2e4d43920d6ff9daff23c7 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family2/7efde2277f2e4d43920d6ff9daff23c7 2023-02-13 12:04:17,474 DEBUG [regionserver/jenkins-hbase16:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 12:04:17,554 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-13 12:04:17,573 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302136084f1455f4d452a8969678d0f2445c8_del 2023-02-13 12:04:17,591 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302137d368ddc700b457a897a622004b03fc4_del 2023-02-13 12:04:17,608 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213fb9333b6f49743da9cb819c4d95a4745_del 2023-02-13 12:04:17,608 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 12:04:17,609 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] zookeeper.ReadOnlyZKClient(139): Connect 0x47424de3 to 127.0.0.1:62284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 12:04:17,654 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26cd28b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 12:04:17,655 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 12:04:18,603 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302135fbcd1eb13ec498ba2321111a6afc698 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302135fbcd1eb13ec498ba2321111a6afc698 2023-02-13 12:04:18,604 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 12:04:18,614 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 12:04:18,616 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:57354, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 12:04:18,623 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 12:04:18,625 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:32792, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 12:04:18,651 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/42f68f95246e48a5825cc60bf117a2fa first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 12:04:18,652 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/42f68f95246e48a5825cc60bf117a2fa}] 2023-02-13 12:04:18,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/42f68f95246e48a5825cc60bf117a2fa for inclusion in 21af9b0de93a32d4dff1e415280782a1/family1 2023-02-13 12:04:18,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 12:04:18,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 12:04:18,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 21af9b0de93a32d4dff1e415280782a1: 2023-02-13 12:04:18,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/42f68f95246e48a5825cc60bf117a2fa to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__1i8kr493eqfr4hooqd5cav5mrv0k5hnbmpip950haivgqqhqc9ce05kqfc3u1jpu/family1/42f68f95246e48a5825cc60bf117a2fa 2023-02-13 12:04:18,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__1i8kr493eqfr4hooqd5cav5mrv0k5hnbmpip950haivgqqhqc9ce05kqfc3u1jpu/family1/42f68f95246e48a5825cc60bf117a2fa as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1e725605730647c1bc488e64c9f50344_SeqId_28_ 2023-02-13 12:04:18,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__1i8kr493eqfr4hooqd5cav5mrv0k5hnbmpip950haivgqqhqc9ce05kqfc3u1jpu/family1/42f68f95246e48a5825cc60bf117a2fa into 21af9b0de93a32d4dff1e415280782a1/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1e725605730647c1bc488e64c9f50344_SeqId_28_ - updating store file list. 2023-02-13 12:04:18,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1e725605730647c1bc488e64c9f50344_SeqId_28_ into 21af9b0de93a32d4dff1e415280782a1/family1 2023-02-13 12:04:18,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__1i8kr493eqfr4hooqd5cav5mrv0k5hnbmpip950haivgqqhqc9ce05kqfc3u1jpu/family1/42f68f95246e48a5825cc60bf117a2fa into 21af9b0de93a32d4dff1e415280782a1/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/family1/1e725605730647c1bc488e64c9f50344_SeqId_28_) 2023-02-13 12:04:18,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__1i8kr493eqfr4hooqd5cav5mrv0k5hnbmpip950haivgqqhqc9ce05kqfc3u1jpu/family1/42f68f95246e48a5825cc60bf117a2fa 2023-02-13 12:04:18,697 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 12:04:18,698 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:18,699 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021361502730c96746c5b7ff2f711680f958 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021361502730c96746c5b7ff2f711680f958 2023-02-13 12:04:18,700 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302136465116b04b4435b88628fbece946bb6 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302136465116b04b4435b88628fbece946bb6 2023-02-13 12:04:18,701 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213821c869acab1429b858c99813b554920 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213821c869acab1429b858c99813b554920 2023-02-13 12:04:18,702 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213fe9ac5f8f1474e53bb5092f6afc3c8f2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213fe9ac5f8f1474e53bb5092f6afc3c8f2 2023-02-13 12:04:18,702 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 12:04:18,702 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 12:04:18,702 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 12:04:18,702 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 12:04:18,756 DEBUG [regionserver/jenkins-hbase16:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 12:04:19,614 DEBUG [regionserver/jenkins-hbase16:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 12:04:19,644 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213418e3afab7414b23a4d34afc1fd41f54 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213418e3afab7414b23a4d34afc1fd41f54 2023-02-13 12:04:19,645 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 12:04:19,686 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/89b38e189d5f4594b8efb63136ea522e first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 12:04:19,687 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/89b38e189d5f4594b8efb63136ea522e}] 2023-02-13 12:04:19,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/89b38e189d5f4594b8efb63136ea522e for inclusion in d6aaa8cbc07ce7f34bfac7a7da7460ba/family1 2023-02-13 12:04:19,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 12:04:19,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 12:04:19,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: 2023-02-13 12:04:19,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/89b38e189d5f4594b8efb63136ea522e to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__sqvlin6lglekpngdohabh58usg9ek638vkhv55spcd35sec687ji1qsapvah0gc6/family1/89b38e189d5f4594b8efb63136ea522e 2023-02-13 12:04:19,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__sqvlin6lglekpngdohabh58usg9ek638vkhv55spcd35sec687ji1qsapvah0gc6/family1/89b38e189d5f4594b8efb63136ea522e as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/8440e0af8c034e20a776e687f5fdb95f_SeqId_28_ 2023-02-13 12:04:19,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__sqvlin6lglekpngdohabh58usg9ek638vkhv55spcd35sec687ji1qsapvah0gc6/family1/89b38e189d5f4594b8efb63136ea522e into d6aaa8cbc07ce7f34bfac7a7da7460ba/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/8440e0af8c034e20a776e687f5fdb95f_SeqId_28_ - updating store file list. 2023-02-13 12:04:19,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/8440e0af8c034e20a776e687f5fdb95f_SeqId_28_ into d6aaa8cbc07ce7f34bfac7a7da7460ba/family1 2023-02-13 12:04:19,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__sqvlin6lglekpngdohabh58usg9ek638vkhv55spcd35sec687ji1qsapvah0gc6/family1/89b38e189d5f4594b8efb63136ea522e into d6aaa8cbc07ce7f34bfac7a7da7460ba/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/family1/8440e0af8c034e20a776e687f5fdb95f_SeqId_28_) 2023-02-13 12:04:19,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__sqvlin6lglekpngdohabh58usg9ek638vkhv55spcd35sec687ji1qsapvah0gc6/family1/89b38e189d5f4594b8efb63136ea522e 2023-02-13 12:04:19,730 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 12:04:19,731 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:19,732 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021300b336b795214ed1843495a0919ff57a to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021300b336b795214ed1843495a0919ff57a 2023-02-13 12:04:19,733 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139e1056f177b64a46bdd35e5049d16fb4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139e1056f177b64a46bdd35e5049d16fb4 2023-02-13 12:04:19,734 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213af2dc009393843b09224be0fada52b6d to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213af2dc009393843b09224be0fada52b6d 2023-02-13 12:04:19,734 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213f41991dd633b44229c1032596f8720a4 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213f41991dd633b44229c1032596f8720a4 2023-02-13 12:04:19,734 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 12:04:19,734 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 12:04:19,735 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 12:04:19,735 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 12:04:20,260 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213eba185c68b924848a73a4384ab43f772 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213eba185c68b924848a73a4384ab43f772 2023-02-13 12:04:20,261 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 12:04:20,312 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/470b4fe837464cc4ab66953cf8506528 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 12:04:20,313 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de., hostname=jenkins-hbase16.apache.org,39857,1676289663697, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/470b4fe837464cc4ab66953cf8506528}] 2023-02-13 12:04:20,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/470b4fe837464cc4ab66953cf8506528 for inclusion in 60a9b9bc2aa1d9558d235def779498de/family1 2023-02-13 12:04:20,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 12:04:20,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 12:04:20,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegion(2445): Flush status journal for 60a9b9bc2aa1d9558d235def779498de: 2023-02-13 12:04:20,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/470b4fe837464cc4ab66953cf8506528 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__ptmq1ijf0p1g5fubc9q524mqj42c1ru9r1861u49gei0i77va0huprcht2okqk58/family1/470b4fe837464cc4ab66953cf8506528 2023-02-13 12:04:20,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__ptmq1ijf0p1g5fubc9q524mqj42c1ru9r1861u49gei0i77va0huprcht2okqk58/family1/470b4fe837464cc4ab66953cf8506528 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/913ebcb4ca8a4cf1a07f5d9a41f6620b_SeqId_28_ 2023-02-13 12:04:20,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__ptmq1ijf0p1g5fubc9q524mqj42c1ru9r1861u49gei0i77va0huprcht2okqk58/family1/470b4fe837464cc4ab66953cf8506528 into 60a9b9bc2aa1d9558d235def779498de/family1 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/913ebcb4ca8a4cf1a07f5d9a41f6620b_SeqId_28_ - updating store file list. 2023-02-13 12:04:20,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/913ebcb4ca8a4cf1a07f5d9a41f6620b_SeqId_28_ into 60a9b9bc2aa1d9558d235def779498de/family1 2023-02-13 12:04:20,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__ptmq1ijf0p1g5fubc9q524mqj42c1ru9r1861u49gei0i77va0huprcht2okqk58/family1/470b4fe837464cc4ab66953cf8506528 into 60a9b9bc2aa1d9558d235def779498de/family1 (new location: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/family1/913ebcb4ca8a4cf1a07f5d9a41f6620b_SeqId_28_) 2023-02-13 12:04:20,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39857] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/staging/jenkins__testMajorCompactionFromAdmin__ptmq1ijf0p1g5fubc9q524mqj42c1ru9r1861u49gei0i77va0huprcht2okqk58/family1/470b4fe837464cc4ab66953cf8506528 2023-02-13 12:04:20,370 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 12:04:20,371 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:20,372 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021311da57148552434ebe3806d788e81249 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021311da57148552434ebe3806d788e81249 2023-02-13 12:04:20,373 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021342d498c25fab4df5810af65df580bca2 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021342d498c25fab4df5810af65df580bca2 2023-02-13 12:04:20,373 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302137e0f16c36da9483a9f2f3fceb6b31c2b to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302137e0f16c36da9483a9f2f3fceb6b31c2b 2023-02-13 12:04:20,374 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302139866fdab0b194bbba2678236cfc653a8 to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302139866fdab0b194bbba2678236cfc653a8 2023-02-13 12:04:20,374 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 12:04:20,374 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 12:04:20,374 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 12:04:20,374 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 12:04:20,374 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 12:04:20,374 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302136084f1455f4d452a8969678d0f2445c8_del] 2023-02-13 12:04:20,375 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:20,376 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302136084f1455f4d452a8969678d0f2445c8_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302136084f1455f4d452a8969678d0f2445c8_del 2023-02-13 12:04:20,376 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 12:04:20,376 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302137d368ddc700b457a897a622004b03fc4_del] 2023-02-13 12:04:20,376 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:20,377 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302137d368ddc700b457a897a622004b03fc4_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302137d368ddc700b457a897a622004b03fc4_del 2023-02-13 12:04:20,377 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 12:04:20,377 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213fb9333b6f49743da9cb819c4d95a4745_del] 2023-02-13 12:04:20,377 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 12:04:20,378 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213fb9333b6f49743da9cb819c4d95a4745_del to hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213fb9333b6f49743da9cb819c4d95a4745_del 2023-02-13 12:04:20,378 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 12:04:20,378 INFO [master/jenkins-hbase16:0:becomeActiveMaster-MasterMobCompaction-1676289667203] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 12:04:20,379 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 12:04:20,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.1120 sec 2023-02-13 12:04:20,399 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:04:20,402 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:04:20,405 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 12:04:20,405 DEBUG [Listener at localhost.localdomain/40603] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 12:04:20,409 INFO [Listener at localhost.localdomain/40603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 12:04:20,446 INFO [Listener at localhost.localdomain/40603] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 258), OpenFileDescriptor=631 (was 645), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=88 (was 91), ProcessCount=165 (was 165), AvailableMemoryMB=5911 (was 5943) 2023-02-13 12:04:20,447 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48d8a74d to 127.0.0.1:62284 2023-02-13 12:04:20,447 DEBUG [Listener at localhost.localdomain/40603] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:04:20,448 INFO [Listener at localhost.localdomain/40603] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 12:04:20,448 INFO [Listener at localhost.localdomain/40603] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 12:04:20,448 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x527571c7 to 127.0.0.1:62284 2023-02-13 12:04:20,448 DEBUG [Listener at localhost.localdomain/40603] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:04:20,448 DEBUG [Listener at localhost.localdomain/40603] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 12:04:20,448 DEBUG [Listener at localhost.localdomain/40603] util.JVMClusterUtil(257): Found active master hash=1939827665, stopped=false 2023-02-13 12:04:20,448 INFO [Listener at localhost.localdomain/40603] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:04:20,495 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 12:04:20,495 INFO [Listener at localhost.localdomain/40603] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 12:04:20,495 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 12:04:20,495 DEBUG [Listener at localhost.localdomain/40603] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32b568fb to 127.0.0.1:62284 2023-02-13 12:04:20,495 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:04:20,495 DEBUG [Listener at localhost.localdomain/40603] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:04:20,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 12:04:20,495 INFO [Listener at localhost.localdomain/40603] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase16.apache.org,39857,1676289663697' ***** 2023-02-13 12:04:20,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 12:04:20,496 INFO [Listener at localhost.localdomain/40603] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 12:04:20,496 INFO [RS:0;jenkins-hbase16:39857] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 12:04:20,496 INFO [RS:0;jenkins-hbase16:39857] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 12:04:20,496 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 12:04:20,496 INFO [RS:0;jenkins-hbase16:39857] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 12:04:20,496 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 1720c79b89223ff190ccb8a9ee0a2e40 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 28693c501211634a844bcf56f3d30bb6 2023-02-13 12:04:20,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 1720c79b89223ff190ccb8a9ee0a2e40, disabling compactions & flushes 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 24b50ded31aa7904f2ee8370503f3b46 2023-02-13 12:04:20,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 98ea924bbcf091ddc51e5c75dcdfc0b7 2023-02-13 12:04:20,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for f38b3449a15ddc7b7f05721277b6b71a 2023-02-13 12:04:20,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. after waiting 0 ms 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 8ee7954bd40bd1dafda1c1f1de68abb8 2023-02-13 12:04:20,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for eae16532ffbd025a3daf5e7ea3cea6e8 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for aab7fec0138e275e2b59795c7bfb8a31 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for c5b275f1912d0846361b5d2dd52a2f88 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 296433c6c439db3f898b5e6f399bb003 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for ccad418e6257284c5dd66c3dc38417e0 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 58ec3f3b39089ccb03970dd0c83adb41 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for d6aaa8cbc07ce7f34bfac7a7da7460ba 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 60a9b9bc2aa1d9558d235def779498de 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for a6f3edcaac9ede8077d2872e0a533416 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 1534d71925ee596bd9145f02d5d5c9c7 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 21af9b0de93a32d4dff1e415280782a1 2023-02-13 12:04:20,497 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 4ed0c483c8c4fe40c830f90411f0787b 2023-02-13 12:04:20,498 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:04:20,498 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1145): stopping server jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:20,498 DEBUG [RS:0;jenkins-hbase16:39857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49afd4b0 to 127.0.0.1:62284 2023-02-13 12:04:20,498 DEBUG [RS:0;jenkins-hbase16:39857] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:04:20,498 INFO [RS:0;jenkins-hbase16:39857] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 12:04:20,499 INFO [RS:0;jenkins-hbase16:39857] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 12:04:20,499 INFO [RS:0;jenkins-hbase16:39857] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 12:04:20,499 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 12:04:20,499 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-13 12:04:20,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 12:04:20,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 12:04:20,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 12:04:20,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 12:04:20,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 12:04:20,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-02-13 12:04:20,500 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1505): Waiting on 1534d71925ee596bd9145f02d5d5c9c7, 1588230740, 1720c79b89223ff190ccb8a9ee0a2e40, 21af9b0de93a32d4dff1e415280782a1, 24b50ded31aa7904f2ee8370503f3b46, 28693c501211634a844bcf56f3d30bb6, 296433c6c439db3f898b5e6f399bb003, 4ed0c483c8c4fe40c830f90411f0787b, 58ec3f3b39089ccb03970dd0c83adb41, 60a9b9bc2aa1d9558d235def779498de, 8ee7954bd40bd1dafda1c1f1de68abb8, 98ea924bbcf091ddc51e5c75dcdfc0b7, a6f3edcaac9ede8077d2872e0a533416, aab7fec0138e275e2b59795c7bfb8a31, c5b275f1912d0846361b5d2dd52a2f88, ccad418e6257284c5dd66c3dc38417e0, d059fb4f5b45884ccdc5e186f572bfc1, d6aaa8cbc07ce7f34bfac7a7da7460ba, eae16532ffbd025a3daf5e7ea3cea6e8, f38b3449a15ddc7b7f05721277b6b71a, fad4ebb8447d36eec1c4a0d741c2ed99 2023-02-13 12:04:20,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/1720c79b89223ff190ccb8a9ee0a2e40/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 12:04:20,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:04:20,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 1720c79b89223ff190ccb8a9ee0a2e40: Waiting for close lock at 1676289860497Running coprocessor pre-close hooks at 1676289860497Disabling compacts and flushes for region at 1676289860497Disabling writes for close at 1676289860497Writing region close event to WAL at 1676289860497Running coprocessor post-close hooks at 1676289860502 (+5 ms)Closed at 1676289860503 (+1 ms) 2023-02-13 12:04:20,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676289777747.1720c79b89223ff190ccb8a9ee0a2e40. 2023-02-13 12:04:20,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 28693c501211634a844bcf56f3d30bb6, disabling compactions & flushes 2023-02-13 12:04:20,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:04:20,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:04:20,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. after waiting 0 ms 2023-02-13 12:04:20,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:04:20,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/28693c501211634a844bcf56f3d30bb6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 12:04:20,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:04:20,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 28693c501211634a844bcf56f3d30bb6: Waiting for close lock at 1676289860503Running coprocessor pre-close hooks at 1676289860503Disabling compacts and flushes for region at 1676289860503Disabling writes for close at 1676289860503Writing region close event to WAL at 1676289860504 (+1 ms)Running coprocessor post-close hooks at 1676289860508 (+4 ms)Closed at 1676289860509 (+1 ms) 2023-02-13 12:04:20,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676289715086.28693c501211634a844bcf56f3d30bb6. 2023-02-13 12:04:20,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 24b50ded31aa7904f2ee8370503f3b46, disabling compactions & flushes 2023-02-13 12:04:20,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:04:20,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:04:20,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. after waiting 0 ms 2023-02-13 12:04:20,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:04:20,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithWeeklyPolicy/24b50ded31aa7904f2ee8370503f3b46/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 12:04:20,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:04:20,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 24b50ded31aa7904f2ee8370503f3b46: Waiting for close lock at 1676289860509Running coprocessor pre-close hooks at 1676289860509Disabling compacts and flushes for region at 1676289860509Disabling writes for close at 1676289860509Writing region close event to WAL at 1676289860510 (+1 ms)Running coprocessor post-close hooks at 1676289860513 (+3 ms)Closed at 1676289860513 2023-02-13 12:04:20,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676289700649.24b50ded31aa7904f2ee8370503f3b46. 2023-02-13 12:04:20,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 98ea924bbcf091ddc51e5c75dcdfc0b7, disabling compactions & flushes 2023-02-13 12:04:20,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:04:20,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:04:20,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. after waiting 0 ms 2023-02-13 12:04:20,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:04:20,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMinorCompactionWithMonthlyPolicy/98ea924bbcf091ddc51e5c75dcdfc0b7/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 12:04:20,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:04:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 98ea924bbcf091ddc51e5c75dcdfc0b7: Waiting for close lock at 1676289860514Running coprocessor pre-close hooks at 1676289860514Disabling compacts and flushes for region at 1676289860514Disabling writes for close at 1676289860514Writing region close event to WAL at 1676289860514Running coprocessor post-close hooks at 1676289860517 (+3 ms)Closed at 1676289860518 (+1 ms) 2023-02-13 12:04:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676289825564.98ea924bbcf091ddc51e5c75dcdfc0b7. 2023-02-13 12:04:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing f38b3449a15ddc7b7f05721277b6b71a, disabling compactions & flushes 2023-02-13 12:04:20,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:04:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:04:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. after waiting 0 ms 2023-02-13 12:04:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:04:20,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyPolicy/f38b3449a15ddc7b7f05721277b6b71a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 12:04:20,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:04:20,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for f38b3449a15ddc7b7f05721277b6b71a: Waiting for close lock at 1676289860518Running coprocessor pre-close hooks at 1676289860518Disabling compacts and flushes for region at 1676289860518Disabling writes for close at 1676289860518Writing region close event to WAL at 1676289860518Running coprocessor post-close hooks at 1676289860522 (+4 ms)Closed at 1676289860522 2023-02-13 12:04:20,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676289720328.f38b3449a15ddc7b7f05721277b6b71a. 2023-02-13 12:04:20,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 8ee7954bd40bd1dafda1c1f1de68abb8, disabling compactions & flushes 2023-02-13 12:04:20,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:04:20,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:04:20,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. after waiting 0 ms 2023-02-13 12:04:20,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:04:20,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/8ee7954bd40bd1dafda1c1f1de68abb8/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 12:04:20,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:04:20,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 8ee7954bd40bd1dafda1c1f1de68abb8: Waiting for close lock at 1676289860522Running coprocessor pre-close hooks at 1676289860522Disabling compacts and flushes for region at 1676289860522Disabling writes for close at 1676289860522Writing region close event to WAL at 1676289860523 (+1 ms)Running coprocessor post-close hooks at 1676289860525 (+2 ms)Closed at 1676289860526 (+1 ms) 2023-02-13 12:04:20,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676289777747.8ee7954bd40bd1dafda1c1f1de68abb8. 2023-02-13 12:04:20,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing eae16532ffbd025a3daf5e7ea3cea6e8, disabling compactions & flushes 2023-02-13 12:04:20,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:04:20,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:04:20,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. after waiting 0 ms 2023-02-13 12:04:20,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:04:20,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/eae16532ffbd025a3daf5e7ea3cea6e8/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 12:04:20,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:04:20,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for eae16532ffbd025a3daf5e7ea3cea6e8: Waiting for close lock at 1676289860526Running coprocessor pre-close hooks at 1676289860526Disabling compacts and flushes for region at 1676289860526Disabling writes for close at 1676289860526Writing region close event to WAL at 1676289860527 (+1 ms)Running coprocessor post-close hooks at 1676289860529 (+2 ms)Closed at 1676289860530 (+1 ms) 2023-02-13 12:04:20,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676289667358.eae16532ffbd025a3daf5e7ea3cea6e8. 2023-02-13 12:04:20,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing aab7fec0138e275e2b59795c7bfb8a31, disabling compactions & flushes 2023-02-13 12:04:20,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:04:20,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:04:20,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. after waiting 0 ms 2023-02-13 12:04:20,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:04:20,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithMonthlyPolicy/aab7fec0138e275e2b59795c7bfb8a31/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 12:04:20,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:04:20,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for aab7fec0138e275e2b59795c7bfb8a31: Waiting for close lock at 1676289860530Running coprocessor pre-close hooks at 1676289860530Disabling compacts and flushes for region at 1676289860530Disabling writes for close at 1676289860530Writing region close event to WAL at 1676289860531 (+1 ms)Running coprocessor post-close hooks at 1676289860533 (+2 ms)Closed at 1676289860534 (+1 ms) 2023-02-13 12:04:20,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676289685056.aab7fec0138e275e2b59795c7bfb8a31. 2023-02-13 12:04:20,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing c5b275f1912d0846361b5d2dd52a2f88, disabling compactions & flushes 2023-02-13 12:04:20,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:04:20,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:04:20,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. after waiting 0 ms 2023-02-13 12:04:20,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:04:20,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/c5b275f1912d0846361b5d2dd52a2f88/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 12:04:20,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:04:20,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for c5b275f1912d0846361b5d2dd52a2f88: Waiting for close lock at 1676289860534Running coprocessor pre-close hooks at 1676289860534Disabling compacts and flushes for region at 1676289860534Disabling writes for close at 1676289860534Writing region close event to WAL at 1676289860535 (+1 ms)Running coprocessor post-close hooks at 1676289860537 (+2 ms)Closed at 1676289860537 2023-02-13 12:04:20,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676289715086.c5b275f1912d0846361b5d2dd52a2f88. 2023-02-13 12:04:20,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 296433c6c439db3f898b5e6f399bb003, disabling compactions & flushes 2023-02-13 12:04:20,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:04:20,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:04:20,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. after waiting 0 ms 2023-02-13 12:04:20,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:04:20,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/296433c6c439db3f898b5e6f399bb003/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 12:04:20,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:04:20,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 296433c6c439db3f898b5e6f399bb003: Waiting for close lock at 1676289860538Running coprocessor pre-close hooks at 1676289860538Disabling compacts and flushes for region at 1676289860538Disabling writes for close at 1676289860538Writing region close event to WAL at 1676289860538Running coprocessor post-close hooks at 1676289860541 (+3 ms)Closed at 1676289860541 2023-02-13 12:04:20,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676289734792.296433c6c439db3f898b5e6f399bb003. 2023-02-13 12:04:20,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing ccad418e6257284c5dd66c3dc38417e0, disabling compactions & flushes 2023-02-13 12:04:20,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:04:20,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:04:20,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. after waiting 0 ms 2023-02-13 12:04:20,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:04:20,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testScannerOnBulkLoadRefHFiles/ccad418e6257284c5dd66c3dc38417e0/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 12:04:20,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:04:20,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for ccad418e6257284c5dd66c3dc38417e0: Waiting for close lock at 1676289860541Running coprocessor pre-close hooks at 1676289860541Disabling compacts and flushes for region at 1676289860541Disabling writes for close at 1676289860541Writing region close event to WAL at 1676289860542 (+1 ms)Running coprocessor post-close hooks at 1676289860544 (+2 ms)Closed at 1676289860545 (+1 ms) 2023-02-13 12:04:20,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676289715086.ccad418e6257284c5dd66c3dc38417e0. 2023-02-13 12:04:20,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 58ec3f3b39089ccb03970dd0c83adb41, disabling compactions & flushes 2023-02-13 12:04:20,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:04:20,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:04:20,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. after waiting 0 ms 2023-02-13 12:04:20,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:04:20,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/58ec3f3b39089ccb03970dd0c83adb41/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 12:04:20,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:04:20,549 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 12:04:20,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 58ec3f3b39089ccb03970dd0c83adb41: Waiting for close lock at 1676289860545Running coprocessor pre-close hooks at 1676289860545Disabling compacts and flushes for region at 1676289860545Disabling writes for close at 1676289860545Writing region close event to WAL at 1676289860546 (+1 ms)Running coprocessor post-close hooks at 1676289860548 (+2 ms)Closed at 1676289860549 (+1 ms) 2023-02-13 12:04:20,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676289753340.58ec3f3b39089ccb03970dd0c83adb41. 2023-02-13 12:04:20,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing d6aaa8cbc07ce7f34bfac7a7da7460ba, disabling compactions & flushes 2023-02-13 12:04:20,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:20,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:20,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. after waiting 0 ms 2023-02-13 12:04:20,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:20,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/d6aaa8cbc07ce7f34bfac7a7da7460ba/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 12:04:20,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:20,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for d6aaa8cbc07ce7f34bfac7a7da7460ba: Waiting for close lock at 1676289860549Running coprocessor pre-close hooks at 1676289860549Disabling compacts and flushes for region at 1676289860549Disabling writes for close at 1676289860549Writing region close event to WAL at 1676289860550 (+1 ms)Running coprocessor post-close hooks at 1676289860553 (+3 ms)Closed at 1676289860554 (+1 ms) 2023-02-13 12:04:20,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676289839292.d6aaa8cbc07ce7f34bfac7a7da7460ba. 2023-02-13 12:04:20,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing fad4ebb8447d36eec1c4a0d741c2ed99, disabling compactions & flushes 2023-02-13 12:04:20,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:04:20,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:04:20,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. after waiting 0 ms 2023-02-13 12:04:20,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:04:20,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/fad4ebb8447d36eec1c4a0d741c2ed99/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 12:04:20,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:04:20,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for fad4ebb8447d36eec1c4a0d741c2ed99: Waiting for close lock at 1676289860554Running coprocessor pre-close hooks at 1676289860554Disabling compacts and flushes for region at 1676289860554Disabling writes for close at 1676289860554Writing region close event to WAL at 1676289860556 (+2 ms)Running coprocessor post-close hooks at 1676289860558 (+2 ms)Closed at 1676289860558 2023-02-13 12:04:20,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676289806837.fad4ebb8447d36eec1c4a0d741c2ed99. 2023-02-13 12:04:20,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 60a9b9bc2aa1d9558d235def779498de, disabling compactions & flushes 2023-02-13 12:04:20,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:20,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:20,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. after waiting 0 ms 2023-02-13 12:04:20,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:20,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/60a9b9bc2aa1d9558d235def779498de/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 12:04:20,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:20,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 60a9b9bc2aa1d9558d235def779498de: Waiting for close lock at 1676289860559Running coprocessor pre-close hooks at 1676289860559Disabling compacts and flushes for region at 1676289860559Disabling writes for close at 1676289860559Writing region close event to WAL at 1676289860560 (+1 ms)Running coprocessor post-close hooks at 1676289860563 (+3 ms)Closed at 1676289860563 2023-02-13 12:04:20,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676289839292.60a9b9bc2aa1d9558d235def779498de. 2023-02-13 12:04:20,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing a6f3edcaac9ede8077d2872e0a533416, disabling compactions & flushes 2023-02-13 12:04:20,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:04:20,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:04:20,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. after waiting 0 ms 2023-02-13 12:04:20,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:04:20,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testCompactionWithHFileLink/a6f3edcaac9ede8077d2872e0a533416/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 12:04:20,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:04:20,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for a6f3edcaac9ede8077d2872e0a533416: Waiting for close lock at 1676289860563Running coprocessor pre-close hooks at 1676289860563Disabling compacts and flushes for region at 1676289860563Disabling writes for close at 1676289860563Writing region close event to WAL at 1676289860564 (+1 ms)Running coprocessor post-close hooks at 1676289860566 (+2 ms)Closed at 1676289860566 2023-02-13 12:04:20,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676289777747.a6f3edcaac9ede8077d2872e0a533416. 2023-02-13 12:04:20,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 1534d71925ee596bd9145f02d5d5c9c7, disabling compactions & flushes 2023-02-13 12:04:20,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:04:20,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:04:20,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. after waiting 0 ms 2023-02-13 12:04:20,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:04:20,568 INFO [regionserver/jenkins-hbase16:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-13 12:04:20,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/1534d71925ee596bd9145f02d5d5c9c7/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 12:04:20,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:04:20,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 1534d71925ee596bd9145f02d5d5c9c7: Waiting for close lock at 1676289860567Running coprocessor pre-close hooks at 1676289860567Disabling compacts and flushes for region at 1676289860567Disabling writes for close at 1676289860567Writing region close event to WAL at 1676289860568 (+1 ms)Running coprocessor post-close hooks at 1676289860570 (+2 ms)Closed at 1676289860570 2023-02-13 12:04:20,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676289806837.1534d71925ee596bd9145f02d5d5c9c7. 2023-02-13 12:04:20,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 21af9b0de93a32d4dff1e415280782a1, disabling compactions & flushes 2023-02-13 12:04:20,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:20,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:20,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. after waiting 0 ms 2023-02-13 12:04:20,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:20,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/default/testMajorCompactionFromAdmin/21af9b0de93a32d4dff1e415280782a1/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 12:04:20,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:20,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 21af9b0de93a32d4dff1e415280782a1: Waiting for close lock at 1676289860570Running coprocessor pre-close hooks at 1676289860570Disabling compacts and flushes for region at 1676289860570Disabling writes for close at 1676289860570Writing region close event to WAL at 1676289860571 (+1 ms)Running coprocessor post-close hooks at 1676289860574 (+3 ms)Closed at 1676289860574 2023-02-13 12:04:20,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676289839292.21af9b0de93a32d4dff1e415280782a1. 2023-02-13 12:04:20,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing 4ed0c483c8c4fe40c830f90411f0787b, disabling compactions & flushes 2023-02-13 12:04:20,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:04:20,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:04:20,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. after waiting 0 ms 2023-02-13 12:04:20,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:04:20,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/ns/testMinorCompaction/4ed0c483c8c4fe40c830f90411f0787b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 12:04:20,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:04:20,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 4ed0c483c8c4fe40c830f90411f0787b: Waiting for close lock at 1676289860574Running coprocessor pre-close hooks at 1676289860574Disabling compacts and flushes for region at 1676289860574Disabling writes for close at 1676289860574Writing region close event to WAL at 1676289860575 (+1 ms)Running coprocessor post-close hooks at 1676289860578 (+3 ms)Closed at 1676289860578 2023-02-13 12:04:20,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676289806837.4ed0c483c8c4fe40c830f90411f0787b. 2023-02-13 12:04:20,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1603): Closing d059fb4f5b45884ccdc5e186f572bfc1, disabling compactions & flushes 2023-02-13 12:04:20,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:04:20,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:04:20,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. after waiting 0 ms 2023-02-13 12:04:20,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:04:20,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2744): Flushing d059fb4f5b45884ccdc5e186f572bfc1 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-13 12:04:20,700 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1505): Waiting on 1588230740, d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:04:20,900 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1505): Waiting on 1588230740, d059fb4f5b45884ccdc5e186f572bfc1 2023-02-13 12:04:20,911 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/.tmp/info/5b6cbc336f8f417f87ae5c6334cda6fa 2023-02-13 12:04:20,919 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b6cbc336f8f417f87ae5c6334cda6fa 2023-02-13 12:04:20,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1/.tmp/info/07a60ccd56534e1d85daac206899bdc5 2023-02-13 12:04:20,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1/.tmp/info/07a60ccd56534e1d85daac206899bdc5 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1/info/07a60ccd56534e1d85daac206899bdc5 2023-02-13 12:04:21,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1/info/07a60ccd56534e1d85daac206899bdc5, entries=3, sequenceid=7, filesize=4.8 K 2023-02-13 12:04:21,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for d059fb4f5b45884ccdc5e186f572bfc1 in 423ms, sequenceid=7, compaction requested=false 2023-02-13 12:04:21,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/namespace/d059fb4f5b45884ccdc5e186f572bfc1/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-13 12:04:21,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:04:21,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for d059fb4f5b45884ccdc5e186f572bfc1: Waiting for close lock at 1676289860578Running coprocessor pre-close hooks at 1676289860578Disabling compacts and flushes for region at 1676289860578Disabling writes for close at 1676289860578Obtaining lock to block concurrent updates at 1676289860578Preparing flush snapshotting stores in d059fb4f5b45884ccdc5e186f572bfc1 at 1676289860578Finished memstore snapshotting hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676289860578Flushing stores of hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. at 1676289860579 (+1 ms)Flushing d059fb4f5b45884ccdc5e186f572bfc1/info: creating writer at 1676289860579Flushing d059fb4f5b45884ccdc5e186f572bfc1/info: appending metadata at 1676289860580 (+1 ms)Flushing d059fb4f5b45884ccdc5e186f572bfc1/info: closing flushed file at 1676289860580Flushing d059fb4f5b45884ccdc5e186f572bfc1/info: reopening flushed file at 1676289860995 (+415 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for d059fb4f5b45884ccdc5e186f572bfc1 in 423ms, sequenceid=7, compaction requested=false at 1676289861001 (+6 ms)Writing region close event to WAL at 1676289861002 (+1 ms)Running coprocessor post-close hooks at 1676289861006 (+4 ms)Closed at 1676289861006 2023-02-13 12:04:21,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676289665893.d059fb4f5b45884ccdc5e186f572bfc1. 2023-02-13 12:04:21,101 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 12:04:21,301 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 12:04:21,326 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/.tmp/rep_barrier/4aa86e2d175b4cda9e272d940295f2f8 2023-02-13 12:04:21,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4aa86e2d175b4cda9e272d940295f2f8 2023-02-13 12:04:21,405 INFO [regionserver/jenkins-hbase16:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 12:04:21,405 INFO [regionserver/jenkins-hbase16:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 12:04:21,501 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 12:04:21,502 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 12:04:21,502 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 12:04:21,702 DEBUG [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 12:04:21,745 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/.tmp/table/7d2fca157a9f4f2e838c5ead46a0d270 2023-02-13 12:04:21,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d2fca157a9f4f2e838c5ead46a0d270 2023-02-13 12:04:21,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/.tmp/info/5b6cbc336f8f417f87ae5c6334cda6fa as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/info/5b6cbc336f8f417f87ae5c6334cda6fa 2023-02-13 12:04:21,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b6cbc336f8f417f87ae5c6334cda6fa 2023-02-13 12:04:21,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/info/5b6cbc336f8f417f87ae5c6334cda6fa, entries=226, sequenceid=130, filesize=37.9 K 2023-02-13 12:04:21,757 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/.tmp/rep_barrier/4aa86e2d175b4cda9e272d940295f2f8 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/rep_barrier/4aa86e2d175b4cda9e272d940295f2f8 2023-02-13 12:04:21,761 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4aa86e2d175b4cda9e272d940295f2f8 2023-02-13 12:04:21,761 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/rep_barrier/4aa86e2d175b4cda9e272d940295f2f8, entries=1, sequenceid=130, filesize=5.0 K 2023-02-13 12:04:21,762 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/.tmp/table/7d2fca157a9f4f2e838c5ead46a0d270 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/table/7d2fca157a9f4f2e838c5ead46a0d270 2023-02-13 12:04:21,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d2fca157a9f4f2e838c5ead46a0d270 2023-02-13 12:04:21,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/table/7d2fca157a9f4f2e838c5ead46a0d270, entries=27, sequenceid=130, filesize=6.6 K 2023-02-13 12:04:21,768 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1269ms, sequenceid=130, compaction requested=false 2023-02-13 12:04:21,774 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-13 12:04:21,774 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 12:04:21,774 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 12:04:21,774 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676289860499Running coprocessor pre-close hooks at 1676289860499Disabling compacts and flushes for region at 1676289860499Disabling writes for close at 1676289860499Obtaining lock to block concurrent updates at 1676289860499Preparing flush snapshotting stores in 1588230740 at 1676289860499Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51839, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676289860500 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676289860500Flushing 1588230740/info: creating writer at 1676289860500Flushing 1588230740/info: appending metadata at 1676289860504 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676289860504Flushing 1588230740/rep_barrier: creating writer at 1676289860920 (+416 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676289860921 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676289860921Flushing 1588230740/table: creating writer at 1676289861337 (+416 ms)Flushing 1588230740/table: appending metadata at 1676289861340 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676289861340Flushing 1588230740/info: reopening flushed file at 1676289861751 (+411 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676289861757 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676289861762 (+5 ms)Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1269ms, sequenceid=130, compaction requested=false at 1676289861768 (+6 ms)Writing region close event to WAL at 1676289861770 (+2 ms)Running coprocessor post-close hooks at 1676289861774 (+4 ms)Closed at 1676289861774 2023-02-13 12:04:21,774 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 12:04:21,902 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1171): stopping server jenkins-hbase16.apache.org,39857,1676289663697; all regions closed. 2023-02-13 12:04:21,919 DEBUG [RS:0;jenkins-hbase16:39857] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/oldWALs 2023-02-13 12:04:21,919 INFO [RS:0;jenkins-hbase16:39857] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C39857%2C1676289663697.meta:.meta(num 1676289665647) 2023-02-13 12:04:21,925 DEBUG [RS:0;jenkins-hbase16:39857] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/oldWALs 2023-02-13 12:04:21,925 INFO [RS:0;jenkins-hbase16:39857] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C39857%2C1676289663697:(num 1676289665560) 2023-02-13 12:04:21,925 DEBUG [RS:0;jenkins-hbase16:39857] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:04:21,925 INFO [RS:0;jenkins-hbase16:39857] regionserver.LeaseManager(133): Closed leases 2023-02-13 12:04:21,926 INFO [RS:0;jenkins-hbase16:39857] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 12:04:21,926 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 12:04:21,927 INFO [RS:0;jenkins-hbase16:39857] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:39857 2023-02-13 12:04:21,970 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,39857,1676289663697 2023-02-13 12:04:21,970 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 12:04:21,970 ERROR [Listener at localhost.localdomain/40603-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6f24b328 rejected from java.util.concurrent.ThreadPoolExecutor@6b1b2a14[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 12:04:21,971 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 12:04:21,971 ERROR [Listener at localhost.localdomain/40603-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@558a25d5 rejected from java.util.concurrent.ThreadPoolExecutor@6b1b2a14[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 12:04:21,981 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,39857,1676289663697] 2023-02-13 12:04:21,982 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,39857,1676289663697; numProcessing=1 2023-02-13 12:04:21,989 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,39857,1676289663697 already deleted, retry=false 2023-02-13 12:04:21,989 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase16.apache.org,39857,1676289663697 expired; onlineServers=0 2023-02-13 12:04:21,990 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase16.apache.org,44533,1676289662559' ***** 2023-02-13 12:04:21,990 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 12:04:21,991 DEBUG [M:0;jenkins-hbase16:44533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32a261ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-02-13 12:04:21,991 INFO [M:0;jenkins-hbase16:44533] regionserver.HRegionServer(1145): stopping server jenkins-hbase16.apache.org,44533,1676289662559 2023-02-13 12:04:21,991 INFO [M:0;jenkins-hbase16:44533] regionserver.HRegionServer(1171): stopping server jenkins-hbase16.apache.org,44533,1676289662559; all regions closed. 2023-02-13 12:04:21,992 DEBUG [M:0;jenkins-hbase16:44533] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 12:04:21,992 DEBUG [M:0;jenkins-hbase16:44533] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 12:04:21,992 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 12:04:21,992 DEBUG [M:0;jenkins-hbase16:44533] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 12:04:21,992 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1676289665196] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1676289665196,5,FailOnTimeoutGroup] 2023-02-13 12:04:21,992 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1676289665195] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1676289665195,5,FailOnTimeoutGroup] 2023-02-13 12:04:21,993 INFO [M:0;jenkins-hbase16:44533] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 12:04:21,993 INFO [M:0;jenkins-hbase16:44533] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 12:04:21,994 INFO [M:0;jenkins-hbase16:44533] hbase.ChoreService(369): Chore service for: master/jenkins-hbase16:0 had [] on shutdown 2023-02-13 12:04:21,995 DEBUG [M:0;jenkins-hbase16:44533] master.HMaster(1502): Stopping service threads 2023-02-13 12:04:21,995 INFO [M:0;jenkins-hbase16:44533] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 12:04:21,996 ERROR [M:0;jenkins-hbase16:44533] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-13 12:04:21,997 INFO [M:0;jenkins-hbase16:44533] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 12:04:21,997 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 12:04:21,998 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 12:04:21,998 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 12:04:21,998 DEBUG [M:0;jenkins-hbase16:44533] zookeeper.ZKUtil(398): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 12:04:21,998 WARN [M:0;jenkins-hbase16:44533] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 12:04:21,998 INFO [M:0;jenkins-hbase16:44533] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 12:04:21,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 12:04:21,998 INFO [M:0;jenkins-hbase16:44533] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 12:04:21,999 DEBUG [M:0;jenkins-hbase16:44533] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 12:04:21,999 INFO [M:0;jenkins-hbase16:44533] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 12:04:21,999 DEBUG [M:0;jenkins-hbase16:44533] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 12:04:21,999 DEBUG [M:0;jenkins-hbase16:44533] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 12:04:21,999 DEBUG [M:0;jenkins-hbase16:44533] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 12:04:21,999 INFO [M:0;jenkins-hbase16:44533] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.25 KB heapSize=599.39 KB 2023-02-13 12:04:22,081 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 12:04:22,081 INFO [RS:0;jenkins-hbase16:39857] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase16.apache.org,39857,1676289663697; zookeeper connection closed. 2023-02-13 12:04:22,081 ERROR [Listener at localhost.localdomain/40603-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d84b3de rejected from java.util.concurrent.ThreadPoolExecutor@6b1b2a14[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 12:04:22,082 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@b26855b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@b26855b 2023-02-13 12:04:22,082 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): regionserver:39857-0x10052c3c9ad0001, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 12:04:22,082 ERROR [Listener at localhost.localdomain/40603-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a1666c2 rejected from java.util.concurrent.ThreadPoolExecutor@6b1b2a14[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 12:04:22,082 INFO [Listener at localhost.localdomain/40603] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-13 12:04:22,409 INFO [M:0;jenkins-hbase16:44533] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.25 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ebc64335454949ebbc58b99796d89423 2023-02-13 12:04:22,429 INFO [M:0;jenkins-hbase16:44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebc64335454949ebbc58b99796d89423 2023-02-13 12:04:22,430 DEBUG [M:0;jenkins-hbase16:44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ebc64335454949ebbc58b99796d89423 as hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ebc64335454949ebbc58b99796d89423 2023-02-13 12:04:22,439 INFO [M:0;jenkins-hbase16:44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebc64335454949ebbc58b99796d89423 2023-02-13 12:04:22,439 INFO [M:0;jenkins-hbase16:44533] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33957/user/jenkins/test-data/d8b709da-9fdf-f682-46bc-d92d5d09e84f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ebc64335454949ebbc58b99796d89423, entries=123, sequenceid=1011, filesize=33.3 K 2023-02-13 12:04:22,440 INFO [M:0;jenkins-hbase16:44533] regionserver.HRegion(2947): Finished flush of dataSize ~513.25 KB/525570, heapSize ~599.38 KB/613760, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 441ms, sequenceid=1011, compaction requested=false 2023-02-13 12:04:22,441 INFO [M:0;jenkins-hbase16:44533] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 12:04:22,441 DEBUG [M:0;jenkins-hbase16:44533] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676289861999Disabling compacts and flushes for region at 1676289861999Disabling writes for close at 1676289861999Obtaining lock to block concurrent updates at 1676289861999Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676289861999Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525570, getHeapSize=613760, getOffHeapSize=0, getCellsCount=1166 at 1676289862000 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676289862000Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676289862001 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676289862005 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676289862005Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676289862432 (+427 ms)Finished flush of dataSize ~513.25 KB/525570, heapSize ~599.38 KB/613760, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 441ms, sequenceid=1011, compaction requested=false at 1676289862440 (+8 ms)Writing region close event to WAL at 1676289862441 (+1 ms)Closed at 1676289862441 2023-02-13 12:04:22,444 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 12:04:22,444 INFO [M:0;jenkins-hbase16:44533] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 12:04:22,445 INFO [M:0;jenkins-hbase16:44533] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:44533 2023-02-13 12:04:22,464 DEBUG [M:0;jenkins-hbase16:44533] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase16.apache.org,44533,1676289662559 already deleted, retry=false 2023-02-13 12:04:22,572 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 12:04:22,572 INFO [M:0;jenkins-hbase16:44533] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase16.apache.org,44533,1676289662559; zookeeper connection closed. 2023-02-13 12:04:22,573 ERROR [Listener at localhost.localdomain/40603-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@8d6d92c rejected from java.util.concurrent.ThreadPoolExecutor@492a3e20[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 12:04:22,573 DEBUG [Listener at localhost.localdomain/40603-EventThread] zookeeper.ZKWatcher(600): master:44533-0x10052c3c9ad0000, quorum=127.0.0.1:62284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 12:04:22,573 ERROR [Listener at localhost.localdomain/40603-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@744c96fc rejected from java.util.concurrent.ThreadPoolExecutor@492a3e20[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 12:04:22,574 WARN [Listener at localhost.localdomain/40603] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 12:04:22,587 WARN [BP-1344872333-188.40.62.62-1676289658691 heartbeating to localhost.localdomain/127.0.0.1:33957] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1344872333-188.40.62.62-1676289658691 (Datanode Uuid 3de10439-cfaa-4823-8c1e-d41da33e5075) service to localhost.localdomain/127.0.0.1:33957 2023-02-13 12:04:22,606 INFO [Listener at localhost.localdomain/40603] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 12:04:22,608 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/cluster_b4fd01dc-bc14-be1f-77f3-175feca8744e/dfs/data/data1/current/BP-1344872333-188.40.62.62-1676289658691] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 12:04:22,609 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5438757b-3af2-b0bb-2eeb-5cd3756e2365/cluster_b4fd01dc-bc14-be1f-77f3-175feca8744e/dfs/data/data2/current/BP-1344872333-188.40.62.62-1676289658691] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 12:04:22,739 INFO [Listener at localhost.localdomain/40603] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 12:04:22,771 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 12:04:22,872 INFO [Listener at localhost.localdomain/40603] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 12:04:22,960 INFO [Listener at localhost.localdomain/40603] hbase.HBaseTestingUtility(1293): Minicluster is down